Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

S3 Function Header tests seems faulty (executed on ceph vm cluster) #438

Open
sumedhak27 opened this issue Apr 5, 2022 · 1 comment
Open

S3 Function Header tests seems faulty (executed on ceph vm cluster) #438

sumedhak27 opened this issue Apr 5, 2022 · 1 comment

Comments

@sumedhak27
Copy link
Contributor

Faulty Tests:

  • test_bucket_create_bad_authorization_empty
  • test_bucket_create_bad_authorization_none
  • test_bucket_create_bad_authorization_invalid_aws2
  • test_bucket_create_bad_date_none_aws2

Issue Description:
The above-mentioned tests are failing on ceph cluster deployed in the virtual machine environment.
When the same tests are performed using REST API, we get the appropriate response. (403 Forbidden)

Ceph/S3-tests Failure Output The test is to set the Authorization header to "" (empty), from the debug request header log we can see that the Authorization header was not set to "". 
$ S3TEST_CONF=./s3tests.motr.conf virtualenv/bin/nosetests  s3tests_boto3.functional.test_headers:test_bucket_create_bad_authorization_empty  -v 2>&1 | tee -a cephtest.log
s3tests_boto3.functional.test_headers.test_bucket_create_bad_authorization_empty ... FAIL

======================================================================
FAIL: s3tests_boto3.functional.test_headers.test_bucket_create_bad_authorization_empty
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/root/ceph-tests/s3-tests/virtualenv/lib/python3.6/site-packages/nose/case.py", line 198, in runTest
    self.test(*self.arg)
  File "/root/ceph-tests/s3-tests/s3tests_boto3/functional/test_headers.py", line 500, in test_bucket_create_bad_authorization_empty
    e = _add_header_create_bad_bucket(headers)
  File "/root/ceph-tests/s3-tests/s3tests_boto3/functional/test_headers.py", line 113, in _add_header_create_bad_bucket
    e = assert_raises(ClientError, client.create_bucket, Bucket=bucket_name)
  File "/root/ceph-tests/s3-tests/s3tests_boto3/functional/utils.py", line 21, in assert_raises
    raise AssertionError("%s not raised" % excName)
AssertionError: ClientError not raised
-------------------- >> begin captured logging << --------------------
botocore.hooks: DEBUG: Changing event name from creating-client-class.iot-data to creating-client-class.iot-data-plane
botocore.hooks: DEBUG: Changing event name from before-call.apigateway to before-call.api-gateway
botocore.hooks: DEBUG: Changing event name from request-created.machinelearning.Predict to request-created.machine-learning.Predict
botocore.hooks: DEBUG: Changing event name from before-parameter-build.autoscaling.CreateLaunchConfiguration to before-parameter-build.auto-scaling.CreateLaunchConfiguration
botocore.hooks: DEBUG: Changing event name from before-parameter-build.route53 to before-parameter-build.route-53
botocore.hooks: DEBUG: Changing event name from request-created.cloudsearchdomain.Search to request-created.cloudsearch-domain.Search
botocore.hooks: DEBUG: Changing event name from docs.*.autoscaling.CreateLaunchConfiguration.complete-section to docs.*.auto-scaling.CreateLaunchConfiguration.complete-section
botocore.hooks: DEBUG: Changing event name from before-parameter-build.logs.CreateExportTask to before-parameter-build.cloudwatch-logs.CreateExportTask
botocore.hooks: DEBUG: Changing event name from docs.*.logs.CreateExportTask.complete-section to docs.*.cloudwatch-logs.CreateExportTask.complete-section
botocore.hooks: DEBUG: Changing event name from before-parameter-build.cloudsearchdomain.Search to before-parameter-build.cloudsearch-domain.Search
botocore.hooks: DEBUG: Changing event name from docs.*.cloudsearchdomain.Search.complete-section to docs.*.cloudsearch-domain.Search.complete-section
botocore.loaders: DEBUG: Loading JSON file: /root/ceph-tests/s3-tests/virtualenv/lib/python3.6/site-packages/botocore/data/endpoints.json
botocore.loaders: DEBUG: Loading JSON file: /root/ceph-tests/s3-tests/virtualenv/lib/python3.6/site-packages/botocore/data/sdk-default-configuration.json
botocore.hooks: DEBUG: Event choose-service-name: calling handler <function handle_service_name_alias at 0x7f00809796a8>
botocore.loaders: DEBUG: Loading JSON file: /root/ceph-tests/s3-tests/virtualenv/lib/python3.6/site-packages/botocore/data/s3/2006-03-01/service-2.json
botocore.hooks: DEBUG: Event creating-client-class.s3: calling handler <function add_generate_presigned_post at 0x7f0080bd00d0>
botocore.hooks: DEBUG: Event creating-client-class.s3: calling handler <function lazy_call.<locals>._handler at 0x7f007fe9e730>
botocore.hooks: DEBUG: Event creating-client-class.s3: calling handler <function add_generate_presigned_url at 0x7f0080bd5e18>
botocore.endpoint: DEBUG: Setting s3 timeout as (60, 60)
botocore.loaders: DEBUG: Loading JSON file: /root/ceph-tests/s3-tests/virtualenv/lib/python3.6/site-packages/botocore/data/_retry.json
botocore.client: DEBUG: Registering retry handlers for service: s3
botocore.hooks: DEBUG: Event choose-service-name: calling handler <function handle_service_name_alias at 0x7f00809796a8>
botocore.hooks: DEBUG: Event creating-client-class.s3: calling handler <function add_generate_presigned_post at 0x7f0080bd00d0>
botocore.hooks: DEBUG: Event creating-client-class.s3: calling handler <function lazy_call.<locals>._handler at 0x7f007fe9e730>
botocore.hooks: DEBUG: Event creating-client-class.s3: calling handler <function add_generate_presigned_url at 0x7f0080bd5e18>
botocore.endpoint: DEBUG: Setting s3 timeout as (60, 60)
botocore.client: DEBUG: Registering retry handlers for service: s3
botocore.hooks: DEBUG: Event choose-service-name: calling handler <function handle_service_name_alias at 0x7f00809796a8>
botocore.hooks: DEBUG: Event creating-client-class.s3: calling handler <function add_generate_presigned_post at 0x7f0080bd00d0>
botocore.hooks: DEBUG: Event creating-client-class.s3: calling handler <function lazy_call.<locals>._handler at 0x7f007fe9e730>
botocore.hooks: DEBUG: Event creating-client-class.s3: calling handler <function add_generate_presigned_url at 0x7f0080bd5e18>
botocore.endpoint: DEBUG: Setting s3 timeout as (60, 60)
botocore.client: DEBUG: Registering retry handlers for service: s3
botocore.hooks: DEBUG: Event before-parameter-build.s3.ListBuckets: calling handler <function validate_bucket_name at 0x7f008090fd08>
botocore.hooks: DEBUG: Event before-parameter-build.s3.ListBuckets: calling handler <bound method S3RegionRedirector.redirect_from_cache of <botocore.utils.S3RegionRedirector object at 0x7f007f4fbc18>>
botocore.hooks: DEBUG: Event before-parameter-build.s3.ListBuckets: calling handler <bound method S3ArnParamHandler.handle_arn of <botocore.utils.S3ArnParamHandler object at 0x7f007f51e048>>
botocore.hooks: DEBUG: Event before-parameter-build.s3.ListBuckets: calling handler <function generate_idempotent_uuid at 0x7f008090fb70>
botocore.hooks: DEBUG: Event before-call.s3.ListBuckets: calling handler <function add_expect_header at 0x7f00809140d0>
botocore.hooks: DEBUG: Event before-call.s3.ListBuckets: calling handler <bound method S3RegionRedirector.set_request_url of <botocore.utils.S3RegionRedirector object at 0x7f007f4fbc18>>
botocore.hooks: DEBUG: Event before-call.s3.ListBuckets: calling handler <function add_recursion_detection_header at 0x7f008090f840>
botocore.hooks: DEBUG: Event before-call.s3.ListBuckets: calling handler <function inject_api_version_header_if_needed at 0x7f0080915378>
botocore.endpoint: DEBUG: Making request for OperationModel(name=ListBuckets) with params: {'url_path': '/', 'query_string': '', 'method': 'GET', 'headers': {'User-Agent': 'Boto3/1.21.33 Python/3.6.8 Linux/4.18.0-305.3.1.el8_4.x86_64 Botocore/1.24.33'}, 'body': b'', 'url': 'http://s3.seagate.com:8000/', 'context': {'client_region': 'us-east-1', 'client_config': <botocore.config.Config object at 0x7f007f4fb8d0>, 'has_streaming_input': False, 'auth_type': None, 'signing': {'bucket': None}}}
botocore.hooks: DEBUG: Event request-created.s3.ListBuckets: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7f007f4fb860>>
botocore.hooks: DEBUG: Event choose-signer.s3.ListBuckets: calling handler <bound method S3EndpointSetter.set_signer of <botocore.utils.S3EndpointSetter object at 0x7f007f51e0b8>>
botocore.hooks: DEBUG: Event choose-signer.s3.ListBuckets: calling handler <function set_operation_specific_signer at 0x7f008090fa60>
botocore.hooks: DEBUG: Event before-sign.s3.ListBuckets: calling handler <bound method S3EndpointSetter.set_endpoint of <botocore.utils.S3EndpointSetter object at 0x7f007f51e0b8>>
botocore.utils: DEBUG: Using S3 path style addressing.
botocore.auth: DEBUG: Calculating signature using v4 auth.
botocore.auth: DEBUG: CanonicalRequest:
GET
/

host:s3.seagate.com:8000
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20220405T112900Z

host;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
botocore.auth: DEBUG: StringToSign:
AWS4-HMAC-SHA256
20220405T112900Z
20220405/us-east-1/s3/aws4_request
22228fc1e8b134ddb0eb200e0ad20cba21136163ec54d59d8cce3de3cf9f3ece
botocore.auth: DEBUG: Signature:
3c4a33971d3a168f1df5024128387f34a21901337e6c0b9c400e725f6b538a06
botocore.hooks: DEBUG: Event request-created.s3.ListBuckets: calling handler <function add_retry_headers at 0x7f00809159d8>
botocore.endpoint: DEBUG: Sending http request: <AWSPreparedRequest stream_output=False, method=GET, url=http://s3.seagate.com:8000/, headers={'User-Agent': b'Boto3/1.21.33 Python/3.6.8 Linux/4.18.0-305.3.1.el8_4.x86_64 Botocore/1.24.33', 'X-Amz-Date': b'20220405T112900Z', 'X-Amz-Content-SHA256': b'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': b'AWS4-HMAC-SHA256 Credential=NB71GXG3O7MMBELODQOO/20220405/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=3c4a33971d3a168f1df5024128387f34a21901337e6c0b9c400e725f6b538a06', 'amz-sdk-invocation-id': b'3d0a7a0e-60f1-47d9-9430-6c8f4d292974', 'amz-sdk-request': b'attempt=1'}>
urllib3.connectionpool: DEBUG: Starting new HTTP connection (1): s3.seagate.com:8000
urllib3.connectionpool: DEBUG: http://s3.seagate.com:8000 "GET / HTTP/1.1" 200 None
botocore.parsers: DEBUG: Response headers: {'Transfer-Encoding': 'chunked', 'Content-Type': 'application/xml', 'Date': 'Tue, 05 Apr 2022 11:29:00 GMT', 'Connection': 'Keep-Alive'}
botocore.parsers: DEBUG: Response body:
b'<?xml version="1.0" encoding="UTF-8"?><ListAllMyBucketsResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Owner><ID>mgwuser</ID><DisplayName>SuperUser</DisplayName></Owner><Buckets><Bucket><Name>emptybkt</Name><CreationDate>2022-03-07T08:43:27.486Z</CreationDate></Bucket><Bucket><Name>hehe</Name><CreationDate>2022-04-04T12:34:53.828Z</CreationDate></Bucket><Bucket><Name>mybkt</Name><CreationDate>2022-02-24T05:35:23.667Z</CreationDate></Bucket><Bucket><Name>mybkt2</Name><CreationDate>2022-03-04T05:46:30.031Z</CreationDate></Bucket><Bucket><Name>testbkt</Name><CreationDate>2022-02-24T11:47:30.855Z</CreationDate></Bucket><Bucket><Name>testbkt1</Name><CreationDate>2022-04-04T05:56:54.843Z</CreationDate></Bucket><Bucket><Name>testbkt2</Name><CreationDate>2022-02-24T12:16:52.286Z</CreationDate></Bucket></Buckets></ListAllMyBucketsResult>'
botocore.hooks: DEBUG: Event needs-retry.s3.ListBuckets: calling handler <botocore.retryhandler.RetryHandler object at 0x7f007f4fbc50>
botocore.retryhandler: DEBUG: No retry needed.
botocore.hooks: DEBUG: Event needs-retry.s3.ListBuckets: calling handler <bound method S3RegionRedirector.redirect_from_error of <botocore.utils.S3RegionRedirector object at 0x7f007f4fbc18>>
botocore.hooks: DEBUG: Event before-parameter-build.s3.ListBuckets: calling handler <function validate_bucket_name at 0x7f008090fd08>
botocore.hooks: DEBUG: Event before-parameter-build.s3.ListBuckets: calling handler <bound method S3RegionRedirector.redirect_from_cache of <botocore.utils.S3RegionRedirector object at 0x7f007f8fbfd0>>
botocore.hooks: DEBUG: Event before-parameter-build.s3.ListBuckets: calling handler <bound method S3ArnParamHandler.handle_arn of <botocore.utils.S3ArnParamHandler object at 0x7f007f8b75f8>>
botocore.hooks: DEBUG: Event before-parameter-build.s3.ListBuckets: calling handler <function generate_idempotent_uuid at 0x7f008090fb70>
botocore.hooks: DEBUG: Event before-call.s3.ListBuckets: calling handler <function add_expect_header at 0x7f00809140d0>
botocore.hooks: DEBUG: Event before-call.s3.ListBuckets: calling handler <bound method S3RegionRedirector.set_request_url of <botocore.utils.S3RegionRedirector object at 0x7f007f8fbfd0>>
botocore.hooks: DEBUG: Event before-call.s3.ListBuckets: calling handler <function add_recursion_detection_header at 0x7f008090f840>
botocore.hooks: DEBUG: Event before-call.s3.ListBuckets: calling handler <function inject_api_version_header_if_needed at 0x7f0080915378>
botocore.endpoint: DEBUG: Making request for OperationModel(name=ListBuckets) with params: {'url_path': '/', 'query_string': '', 'method': 'GET', 'headers': {'User-Agent': 'Boto3/1.21.33 Python/3.6.8 Linux/4.18.0-305.3.1.el8_4.x86_64 Botocore/1.24.33'}, 'body': b'', 'url': 'http://s3.seagate.com:8000/', 'context': {'client_region': 'us-east-1', 'client_config': <botocore.config.Config object at 0x7f007f9a1a20>, 'has_streaming_input': False, 'auth_type': None, 'signing': {'bucket': None}}}
botocore.hooks: DEBUG: Event request-created.s3.ListBuckets: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7f007f9a15f8>>
botocore.hooks: DEBUG: Event choose-signer.s3.ListBuckets: calling handler <bound method S3EndpointSetter.set_signer of <botocore.utils.S3EndpointSetter object at 0x7f007f8b7668>>
botocore.hooks: DEBUG: Event choose-signer.s3.ListBuckets: calling handler <function set_operation_specific_signer at 0x7f008090fa60>
botocore.hooks: DEBUG: Event before-sign.s3.ListBuckets: calling handler <bound method S3EndpointSetter.set_endpoint of <botocore.utils.S3EndpointSetter object at 0x7f007f8b7668>>
botocore.utils: DEBUG: Using S3 path style addressing.
botocore.auth: DEBUG: Calculating signature using v4 auth.
botocore.auth: DEBUG: CanonicalRequest:
GET
/

host:s3.seagate.com:8000
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20220405T112900Z

host;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
botocore.auth: DEBUG: StringToSign:
AWS4-HMAC-SHA256
20220405T112900Z
20220405/us-east-1/s3/aws4_request
22228fc1e8b134ddb0eb200e0ad20cba21136163ec54d59d8cce3de3cf9f3ece
botocore.auth: DEBUG: Signature:
3c4a33971d3a168f1df5024128387f34a21901337e6c0b9c400e725f6b538a06
botocore.hooks: DEBUG: Event request-created.s3.ListBuckets: calling handler <function add_retry_headers at 0x7f00809159d8>
botocore.endpoint: DEBUG: Sending http request: <AWSPreparedRequest stream_output=False, method=GET, url=http://s3.seagate.com:8000/, headers={'User-Agent': b'Boto3/1.21.33 Python/3.6.8 Linux/4.18.0-305.3.1.el8_4.x86_64 Botocore/1.24.33', 'X-Amz-Date': b'20220405T112900Z', 'X-Amz-Content-SHA256': b'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': b'AWS4-HMAC-SHA256 Credential=NB71GXG3O7MMBELODQOO/20220405/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=3c4a33971d3a168f1df5024128387f34a21901337e6c0b9c400e725f6b538a06', 'amz-sdk-invocation-id': b'0f23229b-e36a-4d65-b4f8-7b24546cc54f', 'amz-sdk-request': b'attempt=1'}>
urllib3.connectionpool: DEBUG: Starting new HTTP connection (1): s3.seagate.com:8000
urllib3.connectionpool: DEBUG: http://s3.seagate.com:8000 "GET / HTTP/1.1" 200 None
botocore.parsers: DEBUG: Response headers: {'Transfer-Encoding': 'chunked', 'Content-Type': 'application/xml', 'Date': 'Tue, 05 Apr 2022 11:29:00 GMT', 'Connection': 'Keep-Alive'}
botocore.parsers: DEBUG: Response body:
b'<?xml version="1.0" encoding="UTF-8"?><ListAllMyBucketsResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Owner><ID>mgwuser</ID><DisplayName>SuperUser</DisplayName></Owner><Buckets><Bucket><Name>emptybkt</Name><CreationDate>2022-03-07T08:43:27.486Z</CreationDate></Bucket><Bucket><Name>hehe</Name><CreationDate>2022-04-04T12:34:53.828Z</CreationDate></Bucket><Bucket><Name>mybkt</Name><CreationDate>2022-02-24T05:35:23.667Z</CreationDate></Bucket><Bucket><Name>mybkt2</Name><CreationDate>2022-03-04T05:46:30.031Z</CreationDate></Bucket><Bucket><Name>testbkt</Name><CreationDate>2022-02-24T11:47:30.855Z</CreationDate></Bucket><Bucket><Name>testbkt1</Name><CreationDate>2022-04-04T05:56:54.843Z</CreationDate></Bucket><Bucket><Name>testbkt2</Name><CreationDate>2022-02-24T12:16:52.286Z</CreationDate></Bucket></Buckets></ListAllMyBucketsResult>'
botocore.hooks: DEBUG: Event needs-retry.s3.ListBuckets: calling handler <botocore.retryhandler.RetryHandler object at 0x7f007f8fbe48>
botocore.retryhandler: DEBUG: No retry needed.
botocore.hooks: DEBUG: Event needs-retry.s3.ListBuckets: calling handler <bound method S3RegionRedirector.redirect_from_error of <botocore.utils.S3RegionRedirector object at 0x7f007f8fbfd0>>
botocore.hooks: DEBUG: Event before-parameter-build.s3.ListBuckets: calling handler <function validate_bucket_name at 0x7f008090fd08>
botocore.hooks: DEBUG: Event before-parameter-build.s3.ListBuckets: calling handler <bound method S3RegionRedirector.redirect_from_cache of <botocore.utils.S3RegionRedirector object at 0x7f007f864630>>
botocore.hooks: DEBUG: Event before-parameter-build.s3.ListBuckets: calling handler <bound method S3ArnParamHandler.handle_arn of <botocore.utils.S3ArnParamHandler object at 0x7f007f864a20>>
botocore.hooks: DEBUG: Event before-parameter-build.s3.ListBuckets: calling handler <function generate_idempotent_uuid at 0x7f008090fb70>
botocore.hooks: DEBUG: Event before-call.s3.ListBuckets: calling handler <function add_expect_header at 0x7f00809140d0>
botocore.hooks: DEBUG: Event before-call.s3.ListBuckets: calling handler <bound method S3RegionRedirector.set_request_url of <botocore.utils.S3RegionRedirector object at 0x7f007f864630>>
botocore.hooks: DEBUG: Event before-call.s3.ListBuckets: calling handler <function add_recursion_detection_header at 0x7f008090f840>
botocore.hooks: DEBUG: Event before-call.s3.ListBuckets: calling handler <function inject_api_version_header_if_needed at 0x7f0080915378>
botocore.endpoint: DEBUG: Making request for OperationModel(name=ListBuckets) with params: {'url_path': '/', 'query_string': '', 'method': 'GET', 'headers': {'User-Agent': 'Boto3/1.21.33 Python/3.6.8 Linux/4.18.0-305.3.1.el8_4.x86_64 Botocore/1.24.33'}, 'body': b'', 'url': 'http://s3.seagate.com:8000/', 'context': {'client_region': 'us-east-1', 'client_config': <botocore.config.Config object at 0x7f007f8642e8>, 'has_streaming_input': False, 'auth_type': None, 'signing': {'bucket': None}}}
botocore.hooks: DEBUG: Event request-created.s3.ListBuckets: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7f007f864278>>
botocore.hooks: DEBUG: Event choose-signer.s3.ListBuckets: calling handler <bound method S3EndpointSetter.set_signer of <botocore.utils.S3EndpointSetter object at 0x7f007f864a90>>
botocore.hooks: DEBUG: Event choose-signer.s3.ListBuckets: calling handler <function set_operation_specific_signer at 0x7f008090fa60>
botocore.hooks: DEBUG: Event before-sign.s3.ListBuckets: calling handler <bound method S3EndpointSetter.set_endpoint of <botocore.utils.S3EndpointSetter object at 0x7f007f864a90>>
botocore.utils: DEBUG: Using S3 path style addressing.
botocore.auth: DEBUG: Calculating signature using v4 auth.
botocore.auth: DEBUG: CanonicalRequest:
GET
/

host:s3.seagate.com:8000
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20220405T112900Z

host;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
botocore.auth: DEBUG: StringToSign:
AWS4-HMAC-SHA256
20220405T112900Z
20220405/us-east-1/s3/aws4_request
22228fc1e8b134ddb0eb200e0ad20cba21136163ec54d59d8cce3de3cf9f3ece
botocore.auth: DEBUG: Signature:
3c4a33971d3a168f1df5024128387f34a21901337e6c0b9c400e725f6b538a06
botocore.hooks: DEBUG: Event request-created.s3.ListBuckets: calling handler <function add_retry_headers at 0x7f00809159d8>
botocore.endpoint: DEBUG: Sending http request: <AWSPreparedRequest stream_output=False, method=GET, url=http://s3.seagate.com:8000/, headers={'User-Agent': b'Boto3/1.21.33 Python/3.6.8 Linux/4.18.0-305.3.1.el8_4.x86_64 Botocore/1.24.33', 'X-Amz-Date': b'20220405T112900Z', 'X-Amz-Content-SHA256': b'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': b'AWS4-HMAC-SHA256 Credential=NB71GXG3O7MMBELODQOO/20220405/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=3c4a33971d3a168f1df5024128387f34a21901337e6c0b9c400e725f6b538a06', 'amz-sdk-invocation-id': b'c028de23-07b0-4f4e-be2c-6da8bd047b31', 'amz-sdk-request': b'attempt=1'}>
urllib3.connectionpool: DEBUG: Starting new HTTP connection (1): s3.seagate.com:8000
urllib3.connectionpool: DEBUG: http://s3.seagate.com:8000 "GET / HTTP/1.1" 200 None
botocore.parsers: DEBUG: Response headers: {'Transfer-Encoding': 'chunked', 'Content-Type': 'application/xml', 'Date': 'Tue, 05 Apr 2022 11:29:00 GMT', 'Connection': 'Keep-Alive'}
botocore.parsers: DEBUG: Response body:
b'<?xml version="1.0" encoding="UTF-8"?><ListAllMyBucketsResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Owner><ID>mgwuser</ID><DisplayName>SuperUser</DisplayName></Owner><Buckets><Bucket><Name>emptybkt</Name><CreationDate>2022-03-07T08:43:27.486Z</CreationDate></Bucket><Bucket><Name>hehe</Name><CreationDate>2022-04-04T12:34:53.828Z</CreationDate></Bucket><Bucket><Name>mybkt</Name><CreationDate>2022-02-24T05:35:23.667Z</CreationDate></Bucket><Bucket><Name>mybkt2</Name><CreationDate>2022-03-04T05:46:30.031Z</CreationDate></Bucket><Bucket><Name>testbkt</Name><CreationDate>2022-02-24T11:47:30.855Z</CreationDate></Bucket><Bucket><Name>testbkt1</Name><CreationDate>2022-04-04T05:56:54.843Z</CreationDate></Bucket><Bucket><Name>testbkt2</Name><CreationDate>2022-02-24T12:16:52.286Z</CreationDate></Bucket></Buckets></ListAllMyBucketsResult>'
botocore.hooks: DEBUG: Event needs-retry.s3.ListBuckets: calling handler <botocore.retryhandler.RetryHandler object at 0x7f007f864668>
botocore.retryhandler: DEBUG: No retry needed.
botocore.hooks: DEBUG: Event needs-retry.s3.ListBuckets: calling handler <bound method S3RegionRedirector.redirect_from_error of <botocore.utils.S3RegionRedirector object at 0x7f007f864630>>
botocore.hooks: DEBUG: Event choose-service-name: calling handler <function handle_service_name_alias at 0x7f00809796a8>
botocore.hooks: DEBUG: Event creating-client-class.s3: calling handler <function add_generate_presigned_post at 0x7f0080bd00d0>
botocore.hooks: DEBUG: Event creating-client-class.s3: calling handler <function lazy_call.<locals>._handler at 0x7f007fe9e730>
botocore.hooks: DEBUG: Event creating-client-class.s3: calling handler <function add_generate_presigned_url at 0x7f0080bd5e18>
botocore.endpoint: DEBUG: Setting s3 timeout as (60, 60)
botocore.client: DEBUG: Registering retry handlers for service: s3
botocore.hooks: DEBUG: Event before-parameter-build.s3.CreateBucket: calling handler <function validate_bucket_name at 0x7f008090fd08>
botocore.hooks: DEBUG: Event before-parameter-build.s3.CreateBucket: calling handler <bound method S3RegionRedirector.redirect_from_cache of <botocore.utils.S3RegionRedirector object at 0x7f007f516fd0>>
botocore.hooks: DEBUG: Event before-parameter-build.s3.CreateBucket: calling handler <bound method S3ArnParamHandler.handle_arn of <botocore.utils.S3ArnParamHandler object at 0x7f007f8a0400>>
botocore.hooks: DEBUG: Event before-parameter-build.s3.CreateBucket: calling handler <function generate_idempotent_uuid at 0x7f008090fb70>
botocore.hooks: DEBUG: Event before-call.s3.CreateBucket: calling handler <function _add_header_create_bad_bucket.<locals>.<lambda> at 0x7f007f50f620>
botocore.hooks: DEBUG: Event before-call.s3.CreateBucket: calling handler <function add_expect_header at 0x7f00809140d0>
botocore.hooks: DEBUG: Event before-call.s3.CreateBucket: calling handler <bound method S3RegionRedirector.set_request_url of <botocore.utils.S3RegionRedirector object at 0x7f007f516fd0>>
botocore.hooks: DEBUG: Event before-call.s3.CreateBucket: calling handler <function add_recursion_detection_header at 0x7f008090f840>
botocore.hooks: DEBUG: Event before-call.s3.CreateBucket: calling handler <function inject_api_version_header_if_needed at 0x7f0080915378>
botocore.endpoint: DEBUG: Making request for OperationModel(name=CreateBucket) with params: {'url_path': '/sumedh-t1ssyn1xpcjl2mzh4mcq9e-1', 'query_string': {}, 'method': 'PUT', 'headers': {'User-Agent': 'Boto3/1.21.33 Python/3.6.8 Linux/4.18.0-305.3.1.el8_4.x86_64 Botocore/1.24.33', 'Authorization': ''}, 'body': b'', 'url': 'http://s3.seagate.com:8000/sumedh-t1ssyn1xpcjl2mzh4mcq9e-1', 'context': {'client_region': 'us-east-1', 'client_config': <botocore.config.Config object at 0x7f007f516c88>, 'has_streaming_input': False, 'auth_type': None, 'signing': {'bucket': 'sumedh-t1ssyn1xpcjl2mzh4mcq9e-1'}}}
botocore.hooks: DEBUG: Event request-created.s3.CreateBucket: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7f007f516c18>>
botocore.hooks: DEBUG: Event choose-signer.s3.CreateBucket: calling handler <bound method S3EndpointSetter.set_signer of <botocore.utils.S3EndpointSetter object at 0x7f007f8a0470>>
botocore.hooks: DEBUG: Event choose-signer.s3.CreateBucket: calling handler <function set_operation_specific_signer at 0x7f008090fa60>
botocore.hooks: DEBUG: Event before-sign.s3.CreateBucket: calling handler <bound method S3EndpointSetter.set_endpoint of <botocore.utils.S3EndpointSetter object at 0x7f007f8a0470>>
botocore.utils: DEBUG: Using S3 path style addressing.
botocore.auth: DEBUG: Calculating signature using v4 auth.
botocore.auth: DEBUG: CanonicalRequest:
PUT
/sumedh-t1ssyn1xpcjl2mzh4mcq9e-1

host:s3.seagate.com:8000
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20220405T112900Z

host;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
botocore.auth: DEBUG: StringToSign:
AWS4-HMAC-SHA256
20220405T112900Z
20220405/us-east-1/s3/aws4_request
1d0b623b039917f15061a92204eb94923edb3679bd5efa933460d4f5c9b1766b
botocore.auth: DEBUG: Signature:
9eea05bf0bb3688f5af7fecc1b328533b50451bc7bf20e835ab39f8b0154cd5d
botocore.hooks: DEBUG: Event request-created.s3.CreateBucket: calling handler <function add_retry_headers at 0x7f00809159d8>
botocore.endpoint: DEBUG: Sending http request: <AWSPreparedRequest stream_output=False, method=PUT, url=http://s3.seagate.com:8000/sumedh-t1ssyn1xpcjl2mzh4mcq9e-1, headers={'User-Agent': b'Boto3/1.21.33 Python/3.6.8 Linux/4.18.0-305.3.1.el8_4.x86_64 Botocore/1.24.33', 'X-Amz-Date': b'20220405T112900Z', 'X-Amz-Content-SHA256': b'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': b'AWS4-HMAC-SHA256 Credential=NB71GXG3O7MMBELODQOO/20220405/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=9eea05bf0bb3688f5af7fecc1b328533b50451bc7bf20e835ab39f8b0154cd5d', 'amz-sdk-invocation-id': b'783cce68-fef0-4e57-a502-9a36e04398c5', 'amz-sdk-request': b'attempt=1', 'Content-Length': '0'}>
urllib3.connectionpool: DEBUG: Starting new HTTP connection (1): s3.seagate.com:8000
urllib3.connectionpool: DEBUG: http://s3.seagate.com:8000 "PUT /sumedh-t1ssyn1xpcjl2mzh4mcq9e-1 HTTP/1.1" 200 0
botocore.parsers: DEBUG: Response headers: {'Content-Length': '0', 'Date': 'Tue, 05 Apr 2022 11:29:00 GMT', 'Connection': 'Keep-Alive'}
botocore.parsers: DEBUG: Response body:
b''
botocore.hooks: DEBUG: Event needs-retry.s3.CreateBucket: calling handler <botocore.retryhandler.RetryHandler object at 0x7f007f8a0048>
botocore.retryhandler: DEBUG: No retry needed.
botocore.hooks: DEBUG: Event needs-retry.s3.CreateBucket: calling handler <bound method S3RegionRedirector.redirect_from_error of <botocore.utils.S3RegionRedirector object at 0x7f007f516fd0>>
--------------------- >> end captured logging << ---------------------

----------------------------------------------------------------------
Ran 1 test in 0.796s

FAILED (failures=1)
(virtualenv)
Test output using REST API 
~/ceph-client ⌚ 4:29:18
$  cd /root/ceph-client ; /usr/bin/env /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.312.b07-2.el8_5.x86_64/bin/java -ag
entlib:jdwp=transport=dt_socket,server=n,suspend=y,address=localhost:34569 -cp /tmp/cp_bbidnu5w7per3qn9hi9pyfa63
.jar com.seagate.ceph_client.CephAdminAPIClient 
Date: Mon, 4 Apr 2022 10:35:34 GMT
HeaderString: PUT

Mon, 4 Apr 2022 10:35:34 GMT
/hehe
Auth: 

HTTP/1.1 403 ForbiddenResponse Content is: {"Code":"AccessDenied","BucketName":"hehe","RequestId":"tx000008d3648d298f720bc-00624ac9f7-1050-default","HostId":"1050-default-default"}
@romayalon
Copy link
Contributor

Hi @sumedhak27
Did you find out what went wrong causing these tests to fail?
I started seeing these tests failing today

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@romayalon @sumedhak27