Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Chamber is not working with recommended AWS SSO config that uses sso-session #396

Closed
jim-barber-he opened this issue Jun 7, 2023 · 15 comments
Closed

Chamber is not working with recommended AWS SSO config that uses sso-session #396

jim-barber-he opened this issue Jun 7, 2023 · 15 comments
Labels
bug

Comments

@jim-barber-he
Copy link

AWS IAM Identity Center (formerly known as AWS SSO) has two ways of being configured.
There's the recommended way that uses sessions with automatic token refresh: https://docs.aws.amazon.com/cli/latest/userguide/sso-configure-profile-token.html
And the old legacy way: https://docs.aws.amazon.com/cli/latest/userguide/sso-configure-profile-legacy.html

Chamber works fine with the legacy method, however it does not work with the recommended method.

Legacy:

$ AWS_PROFILE=test chamber list test/common
Key					Version		LastModified		User
aws_account_alias			0		2022-11-17 07:37:30	REDACTED
aws_account_id				0		2022-11-17 07:37:30	REDACTED

Recommended:

$ AWS_PROFILE=test chamber list test/common
Error: Failed to get secret store: profile "test" is configured to use SSO but is missing required configuration: sso_region, sso_start_url

Redacted legacy config in ~/.aws/config:

[profile test]
region = ap-southeast-2
sso_account_id = 000000000000
sso_region = ap-southeast-2
sso_role_name = ReadOnly
sso_start_url = https://COMPANY.awsapps.com/start

Redacted recommended config in ~/.aws/confg:

[profile test]
region = ap-southeast-2
sso_account_id = 000000000000
sso_role_name = ReadOnly
sso_session = common

[sso-session common]
sso_region = ap-southeast-2
sso_registration_scopes = sso:account:access
sso_start_url = https://COMPANY.awsapps.com/start

I suspect the fix will be to update the aws-sdk-go dependency
@alecjacobs5401
Copy link
Contributor

@jim-barber-he can you confirm what your current chamber version is?

I suspect the fix will be to update the aws-sdk-go dependency

We recently released an updated version that brought us up to latest for aws-sdk-go

@jim-barber-he
Copy link
Author

jim-barber-he commented Jun 8, 2023 •
edited

Ah sorry, the version information is pretty important...

$ chamber version  
chamber v2.13.0

We recently released an updated version that brought us up to latest for aws-sdk-go

Okay, that was purely speculation on my part with nothing to back it up. I was hoping the fix would be as easy as that. :)

@alecjacobs5401
Copy link
Contributor

@jim-barber-he got it, thanks!

On a whim, do you mind checking out latest master, building, and testing out your SSO configuration to see if by chance it was fixed? We just merged in a patch version update to aws-sdk-go (#397) and want to verify if all that is needed here is a new release.

All that should be necessary is make build in the root of the repo

@jim-barber-he
Copy link
Author

I get the same result.

$ chamber version           
chamber v2.13.0-5-g702722d

$ AWS_PROFILE=test chamber list test/common
Error: Failed to get secret store: profile "test" is configured to use SSO but is missing required configuration: sso_region, sso_start_url

@alecjacobs5401
Copy link
Contributor

Thanks for checking!

Looking into it a little, we may need to bump to aws-sdk-v2 for this. Not sure when we'll get around to it.

@jim-barber-he
Copy link
Author

aws-sdk-go has an issue raised against it about not supporting the new sso-session configuration:
aws/aws-sdk-go#4649

It looks like a pull request to add support to it was raised 3 hours ago:
aws/aws-sdk-go#4885

So with any luck, once this is merged and a release of aws-sdk-go comes out with it, then upgrading to that should hopefully fix it.

@jim-barber-he
Copy link
Author

The support for sso-session for aws-sdk-go has been merged and is now in a release.
https://github.com/aws/aws-sdk-go/releases/tag/v1.44.298

@alecjacobs5401
Copy link
Contributor

Updated aws-sdk-go has been merged in #406

Will resolve this with a release

@alecjacobs5401
Copy link
Contributor

v2.13.2 is now release which should resolve this problem for you @jim-barber-he

Let me know if all is good (and feel free to close out the issue if so)

@jim-barber-he
Copy link
Author

With the old AWS config the new version works as did the old one.

$ chamber version      
chamber v2.13.2
$ AWS_PROFILE=test chamber list test/common
Key					Version		LastModified		User
aws_account_alias			0		2022-11-17 07:37:30	REDACTED
aws_account_id				0		2022-11-17 07:37:30	REDACTED

With the new sso-session AWS config, chamber no longer errors with saying it is missing required configuration: sso_region, sso_start_url
However it now sits there for a few seconds before encountering a fatal error where it has exceeded memory and shows a stack trace.

runtime: goroutine stack exceeds 1000000000-byte limit
runtime: sp=0xc025b01470 stack=[0xc025b00000, 0xc045b00000]
fatal error: stack overflow

runtime stack:
runtime.throw({0xd959fb?, 0x15d86c0?})
	runtime/panic.go:1047 +0x5d fp=0xc000711e18 sp=0xc000711de8 pc=0x4350bd
runtime.newstack()
	runtime/stack.go:1105 +0x5bd fp=0xc000711fc8 sp=0xc000711e18 pc=0x44ecfd
runtime.morestack()
	runtime/asm_amd64.s:574 +0x8b fp=0xc000711fd0 sp=0xc000711fc8 pc=0x464e6b

goroutine 1 [running]:
github.com/aws/aws-sdk-go/internal/ini.parse({0xc0212dc000, 0x47a, 0x47b})
	github.com/aws/aws-sdk-go@v1.44.298/internal/ini/ini_parser.go:143 +0x2f65 fp=0xc025b01480 sp=0xc025b01478 pc=0x6e1445
github.com/aws/aws-sdk-go/internal/ini.ParseAST({0x1077e00?, 0xc013f0e430?})
	github.com/aws/aws-sdk-go@v1.44.298/internal/ini/ini_parser.go:128 +0x4e fp=0xc025b014a8 sp=0xc025b01480 pc=0x6de4ae
github.com/aws/aws-sdk-go/internal/ini.Parse({0x1077e00?, 0xc013f0e430?})
	github.com/aws/aws-sdk-go@v1.44.298/internal/ini/ini.go:25 +0x27 fp=0xc025b01500 sp=0xc025b014a8 pc=0x6dd3a7
github.com/aws/aws-sdk-go/internal/ini.OpenFile({0xc02215e318?, 0x0?})
	github.com/aws/aws-sdk-go@v1.44.298/internal/ini/ini.go:19 +0x1b5 fp=0xc025b015b0 sp=0xc025b01500 pc=0x6dd275
github.com/aws/aws-sdk-go/aws/session.loadSharedConfigIniFiles({0xc025b02298, 0x2, 0x0?})
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/shared_config.go:248 +0xbd fp=0xc025b01670 sp=0xc025b015b0 pc=0x9ad37d
github.com/aws/aws-sdk-go/aws/session.loadSharedConfig({_, _}, {_, _, _}, _)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/shared_config.go:230 +0x85 fp=0xc025b01988 sp=0xc025b01670 pc=0x9ad085
github.com/aws/aws-sdk-go/aws/session.newSession({{0x0, 0x0, 0x0, {0x0, 0x0}, 0x0, 0x0, 0x0, 0x0, 0x0, ...}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/session.go:485 +0x2c5 fp=0xc025b029f8 sp=0xc025b01988 pc=0x9a8d45
github.com/aws/aws-sdk-go/aws/session.NewSessionWithOptions({{0x0, 0x0, 0x0, {0x0, 0x0}, 0x0, 0x0, 0x0, 0x0, 0x0, ...}, ...})
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/session.go:368 +0x348 fp=0xc025b03230 sp=0xc025b029f8 pc=0x9a8088
github.com/aws/aws-sdk-go/aws/session.NewSession({0x0, 0x0, 0x0?})
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/session.go:152 +0xb8 fp=0xc025b03908 sp=0xc025b03230 pc=0x9a7cf8
github.com/aws/aws-sdk-go/aws/session.resolveSSOCredentials(_, {{0xc022112c10, 0x9}, {{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, ...}}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/credentials.go:194 +0x147 fp=0xc025b03d00 sp=0xc025b03908 pc=0x9a4f87
github.com/aws/aws-sdk-go/aws/session.resolveCredsFromProfile(_, {{{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, {0xc000028193, ...}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/credentials.go:138 +0x25b fp=0xc025b04a80 sp=0xc025b03d00 pc=0x9a467b
github.com/aws/aws-sdk-go/aws/session.resolveCredsFromProfile(_, {{{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, {0xc000028193, ...}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/credentials.go:111 +0x8be fp=0xc025b05800 sp=0xc025b04a80 pc=0x9a4cde
github.com/aws/aws-sdk-go/aws/session.resolveCredentials(_, {{{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, {0xc000028193, ...}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/credentials.go:62 +0x2be fp=0xc025b06120 sp=0xc025b05800 pc=0x9a3f1e
github.com/aws/aws-sdk-go/aws/session.mergeConfigSrcs(_, _, {{{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/session.go:808 +0x7c5 fp=0xc025b06a90 sp=0xc025b06120 pc=0x9ab765
github.com/aws/aws-sdk-go/aws/session.newSession({{0x0, 0x0, 0x0, {0x0, 0x0}, 0x0, 0x0, 0x0, 0x0, 0x0, ...}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/session.go:498 +0x4ae fp=0xc025b07b00 sp=0xc025b06a90 pc=0x9a8f2e
github.com/aws/aws-sdk-go/aws/session.NewSessionWithOptions({{0x0, 0x0, 0x0, {0x0, 0x0}, 0x0, 0x0, 0x0, 0x0, 0x0, ...}, ...})
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/session.go:368 +0x348 fp=0xc025b08338 sp=0xc025b07b00 pc=0x9a8088
github.com/aws/aws-sdk-go/aws/session.NewSession({0x0, 0x0, 0x0?})
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/session.go:152 +0xb8 fp=0xc025b08a10 sp=0xc025b08338 pc=0x9a7cf8
github.com/aws/aws-sdk-go/aws/session.resolveSSOCredentials(_, {{0xc0221120c0, 0x9}, {{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, ...}}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/credentials.go:194 +0x147 fp=0xc025b08e08 sp=0xc025b08a10 pc=0x9a4f87
github.com/aws/aws-sdk-go/aws/session.resolveCredsFromProfile(_, {{{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, {0xc000028193, ...}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/credentials.go:138 +0x25b fp=0xc025b09b88 sp=0xc025b08e08 pc=0x9a467b
github.com/aws/aws-sdk-go/aws/session.resolveCredsFromProfile(_, {{{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, {0xc000028193, ...}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/credentials.go:111 +0x8be fp=0xc025b0a908 sp=0xc025b09b88 pc=0x9a4cde
github.com/aws/aws-sdk-go/aws/session.resolveCredentials(_, {{{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, {0xc000028193, ...}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/credentials.go:62 +0x2be fp=0xc025b0b228 sp=0xc025b0a908 pc=0x9a3f1e
github.com/aws/aws-sdk-go/aws/session.mergeConfigSrcs(_, _, {{{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/session.go:808 +0x7c5 fp=0xc025b0bb98 sp=0xc025b0b228 pc=0x9ab765
github.com/aws/aws-sdk-go/aws/session.newSession({{0x0, 0x0, 0x0, {0x0, 0x0}, 0x0, 0x0, 0x0, 0x0, 0x0, ...}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/session.go:498 +0x4ae fp=0xc025b0cc08 sp=0xc025b0bb98 pc=0x9a8f2e
github.com/aws/aws-sdk-go/aws/session.NewSessionWithOptions({{0x0, 0x0, 0x0, {0x0, 0x0}, 0x0, 0x0, 0x0, 0x0, 0x0, ...}, ...})
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/session.go:368 +0x348 fp=0xc025b0d440 sp=0xc025b0cc08 pc=0x9a8088
github.com/aws/aws-sdk-go/aws/session.NewSession({0x0, 0x0, 0x0?})
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/session.go:152 +0xb8 fp=0xc025b0db18 sp=0xc025b0d440 pc=0x9a7cf8
github.com/aws/aws-sdk-go/aws/session.resolveSSOCredentials(_, {{0xc0220395d0, 0x9}, {{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, ...}}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/credentials.go:194 +0x147 fp=0xc025b0df10 sp=0xc025b0db18 pc=0x9a4f87
github.com/aws/aws-sdk-go/aws/session.resolveCredsFromProfile(_, {{{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, {0xc000028193, ...}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/credentials.go:138 +0x25b fp=0xc025b0ec90 sp=0xc025b0df10 pc=0x9a467b
github.com/aws/aws-sdk-go/aws/session.resolveCredsFromProfile(_, {{{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, {0xc000028193, ...}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/credentials.go:111 +0x8be fp=0xc025b0fa10 sp=0xc025b0ec90 pc=0x9a4cde
github.com/aws/aws-sdk-go/aws/session.resolveCredentials(_, {{{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, {0xc000028193, ...}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/credentials.go:62 +0x2be fp=0xc025b10330 sp=0xc025b0fa10 pc=0x9a3f1e
github.com/aws/aws-sdk-go/aws/session.mergeConfigSrcs(_, _, {{{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/session.go:808 +0x7c5 fp=0xc025b10ca0 sp=0xc025b10330 pc=0x9ab765
github.com/aws/aws-sdk-go/aws/session.newSession({{0x0, 0x0, 0x0, {0x0, 0x0}, 0x0, 0x0, 0x0, 0x0, 0x0, ...}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/session.go:498 +0x4ae fp=0xc025b11d10 sp=0xc025b10ca0 pc=0x9a8f2e
github.com/aws/aws-sdk-go/aws/session.NewSessionWithOptions({{0x0, 0x0, 0x0, {0x0, 0x0}, 0x0, 0x0, 0x0, 0x0, 0x0, ...}, ...})
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/session.go:368 +0x348 fp=0xc025b12548 sp=0xc025b11d10 pc=0x9a8088
github.com/aws/aws-sdk-go/aws/session.NewSession({0x0, 0x0, 0x0?})
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/session.go:152 +0xb8 fp=0xc025b12c20 sp=0xc025b12548 pc=0x9a7cf8
github.com/aws/aws-sdk-go/aws/session.resolveSSOCredentials(_, {{0xc022038ad0, 0x9}, {{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, ...}}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/credentials.go:194 +0x147 fp=0xc025b13018 sp=0xc025b12c20 pc=0x9a4f87
github.com/aws/aws-sdk-go/aws/session.resolveCredsFromProfile(_, {{{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, {0xc000028193, ...}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/credentials.go:138 +0x25b fp=0xc025b13d98 sp=0xc025b13018 pc=0x9a467b
github.com/aws/aws-sdk-go/aws/session.resolveCredsFromProfile(_, {{{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, {0xc000028193, ...}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/credentials.go:111 +0x8be fp=0xc025b14b18 sp=0xc025b13d98 pc=0x9a4cde
github.com/aws/aws-sdk-go/aws/session.resolveCredentials(_, {{{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, {0xc000028193, ...}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/credentials.go:62 +0x2be fp=0xc025b15438 sp=0xc025b14b18 pc=0x9a3f1e
github.com/aws/aws-sdk-go/aws/session.mergeConfigSrcs(_, _, {{{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/session.go:808 +0x7c5 fp=0xc025b15da8 sp=0xc025b15438 pc=0x9ab765
github.com/aws/aws-sdk-go/aws/session.newSession({{0x0, 0x0, 0x0, {0x0, 0x0}, 0x0, 0x0, 0x0, 0x0, 0x0, ...}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/session.go:498 +0x4ae fp=0xc025b16e18 sp=0xc025b15da8 pc=0x9a8f2e
github.com/aws/aws-sdk-go/aws/session.NewSessionWithOptions({{0x0, 0x0, 0x0, {0x0, 0x0}, 0x0, 0x0, 0x0, 0x0, 0x0, ...}, ...})
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/session.go:368 +0x348 fp=0xc025b17650 sp=0xc025b16e18 pc=0x9a8088
github.com/aws/aws-sdk-go/aws/session.NewSession({0x0, 0x0, 0x0?})
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/session.go:152 +0xb8 fp=0xc025b17d28 sp=0xc025b17650 pc=0x9a7cf8
github.com/aws/aws-sdk-go/aws/session.resolveSSOCredentials(_, {{0xc021f5bfe0, 0x9}, {{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, ...}}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/credentials.go:194 +0x147 fp=0xc025b18120 sp=0xc025b17d28 pc=0x9a4f87
github.com/aws/aws-sdk-go/aws/session.resolveCredsFromProfile(_, {{{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, {0xc000028193, ...}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/credentials.go:138 +0x25b fp=0xc025b18ea0 sp=0xc025b18120 pc=0x9a467b
github.com/aws/aws-sdk-go/aws/session.resolveCredsFromProfile(_, {{{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, {0xc000028193, ...}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/credentials.go:111 +0x8be fp=0xc025b19c20 sp=0xc025b18ea0 pc=0x9a4cde
github.com/aws/aws-sdk-go/aws/session.resolveCredentials(_, {{{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, {0xc000028193, ...}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/credentials.go:62 +0x2be fp=0xc025b1a540 sp=0xc025b19c20 pc=0x9a3f1e
github.com/aws/aws-sdk-go/aws/session.mergeConfigSrcs(_, _, {{{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/session.go:808 +0x7c5 fp=0xc025b1aeb0 sp=0xc025b1a540 pc=0x9ab765
github.com/aws/aws-sdk-go/aws/session.newSession({{0x0, 0x0, 0x0, {0x0, 0x0}, 0x0, 0x0, 0x0, 0x0, 0x0, ...}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/session.go:498 +0x4ae fp=0xc025b1bf20 sp=0xc025b1aeb0 pc=0x9a8f2e
github.com/aws/aws-sdk-go/aws/session.NewSessionWithOptions({{0x0, 0x0, 0x0, {0x0, 0x0}, 0x0, 0x0, 0x0, 0x0, 0x0, ...}, ...})
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/session.go:368 +0x348 fp=0xc025b1c758 sp=0xc025b1bf20 pc=0x9a8088
github.com/aws/aws-sdk-go/aws/session.NewSession({0x0, 0x0, 0x0?})
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/session.go:152 +0xb8 fp=0xc025b1ce30 sp=0xc025b1c758 pc=0x9a7cf8
github.com/aws/aws-sdk-go/aws/session.resolveSSOCredentials(_, {{0xc021f5b4e0, 0x9}, {{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, ...}}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/credentials.go:194 +0x147 fp=0xc025b1d228 sp=0xc025b1ce30 pc=0x9a4f87
github.com/aws/aws-sdk-go/aws/session.resolveCredsFromProfile(_, {{{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, {0xc000028193, ...}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/credentials.go:138 +0x25b fp=0xc025b1dfa8 sp=0xc025b1d228 pc=0x9a467b
github.com/aws/aws-sdk-go/aws/session.resolveCredsFromProfile(_, {{{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, {0xc000028193, ...}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/credentials.go:111 +0x8be fp=0xc025b1ed28 sp=0xc025b1dfa8 pc=0x9a4cde
github.com/aws/aws-sdk-go/aws/session.resolveCredentials(_, {{{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, {0xc000028193, ...}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/credentials.go:62 +0x2be fp=0xc025b1f648 sp=0xc025b1ed28 pc=0x9a3f1e
github.com/aws/aws-sdk-go/aws/session.mergeConfigSrcs(_, _, {{{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/session.go:808 +0x7c5 fp=0xc025b1ffb8 sp=0xc025b1f648 pc=0x9ab765
github.com/aws/aws-sdk-go/aws/session.newSession({{0x0, 0x0, 0x0, {0x0, 0x0}, 0x0, 0x0, 0x0, 0x0, 0x0, ...}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/session.go:498 +0x4ae fp=0xc025b21028 sp=0xc025b1ffb8 pc=0x9a8f2e
github.com/aws/aws-sdk-go/aws/session.NewSessionWithOptions({{0x0, 0x0, 0x0, {0x0, 0x0}, 0x0, 0x0, 0x0, 0x0, 0x0, ...}, ...})
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/session.go:368 +0x348 fp=0xc025b21860 sp=0xc025b21028 pc=0x9a8088
github.com/aws/aws-sdk-go/aws/session.NewSession({0x0, 0x0, 0x0?})
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/session.go:152 +0xb8 fp=0xc025b21f38 sp=0xc025b21860 pc=0x9a7cf8
github.com/aws/aws-sdk-go/aws/session.resolveSSOCredentials(_, {{0xc021f5a9f0, 0x9}, {{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, ...}}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/credentials.go:194 +0x147 fp=0xc025b22330 sp=0xc025b21f38 pc=0x9a4f87
github.com/aws/aws-sdk-go/aws/session.resolveCredsFromProfile(_, {{{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, {0xc000028193, ...}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/credentials.go:138 +0x25b fp=0xc025b230b0 sp=0xc025b22330 pc=0x9a467b
github.com/aws/aws-sdk-go/aws/session.resolveCredsFromProfile(_, {{{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, {0xc000028193, ...}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/credentials.go:111 +0x8be fp=0xc025b23e30 sp=0xc025b230b0 pc=0x9a4cde
github.com/aws/aws-sdk-go/aws/session.resolveCredentials(_, {{{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, {0xc000028193, ...}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/credentials.go:62 +0x2be fp=0xc025b24750 sp=0xc025b23e30 pc=0x9a3f1e
github.com/aws/aws-sdk-go/aws/session.mergeConfigSrcs(_, _, {{{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/session.go:808 +0x7c5 fp=0xc025b250c0 sp=0xc025b24750 pc=0x9ab765
github.com/aws/aws-sdk-go/aws/session.newSession({{0x0, 0x0, 0x0, {0x0, 0x0}, 0x0, 0x0, 0x0, 0x0, 0x0, ...}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/session.go:498 +0x4ae fp=0xc025b26130 sp=0xc025b250c0 pc=0x9a8f2e
github.com/aws/aws-sdk-go/aws/session.NewSessionWithOptions({{0x0, 0x0, 0x0, {0x0, 0x0}, 0x0, 0x0, 0x0, 0x0, 0x0, ...}, ...})
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/session.go:368 +0x348 fp=0xc025b26968 sp=0xc025b26130 pc=0x9a8088
github.com/aws/aws-sdk-go/aws/session.NewSession({0x0, 0x0, 0x0?})
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/session.go:152 +0xb8 fp=0xc025b27040 sp=0xc025b26968 pc=0x9a7cf8
github.com/aws/aws-sdk-go/aws/session.resolveSSOCredentials(_, {{0xc021e77ef0, 0x9}, {{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, ...}}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/credentials.go:194 +0x147 fp=0xc025b27438 sp=0xc025b27040 pc=0x9a4f87
github.com/aws/aws-sdk-go/aws/session.resolveCredsFromProfile(_, {{{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, {0xc000028193, ...}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/credentials.go:138 +0x25b fp=0xc025b281b8 sp=0xc025b27438 pc=0x9a467b
github.com/aws/aws-sdk-go/aws/session.resolveCredsFromProfile(_, {{{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, {0xc000028193, ...}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/credentials.go:111 +0x8be fp=0xc025b28f38 sp=0xc025b281b8 pc=0x9a4cde
github.com/aws/aws-sdk-go/aws/session.resolveCredentials(_, {{{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, {0xc000028193, ...}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/credentials.go:62 +0x2be fp=0xc025b29858 sp=0xc025b28f38 pc=0x9a3f1e
github.com/aws/aws-sdk-go/aws/session.mergeConfigSrcs(_, _, {{{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/session.go:808 +0x7c5 fp=0xc025b2a1c8 sp=0xc025b29858 pc=0x9ab765
github.com/aws/aws-sdk-go/aws/session.newSession({{0x0, 0x0, 0x0, {0x0, 0x0}, 0x0, 0x0, 0x0, 0x0, 0x0, ...}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/session.go:498 +0x4ae fp=0xc025b2b238 sp=0xc025b2a1c8 pc=0x9a8f2e
github.com/aws/aws-sdk-go/aws/session.NewSessionWithOptions({{0x0, 0x0, 0x0, {0x0, 0x0}, 0x0, 0x0, 0x0, 0x0, 0x0, ...}, ...})
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/session.go:368 +0x348 fp=0xc025b2ba70 sp=0xc025b2b238 pc=0x9a8088
github.com/aws/aws-sdk-go/aws/session.NewSession({0x0, 0x0, 0x0?})
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/session.go:152 +0xb8 fp=0xc025b2c148 sp=0xc025b2ba70 pc=0x9a7cf8
github.com/aws/aws-sdk-go/aws/session.resolveSSOCredentials(_, {{0xc021e77400, 0x9}, {{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, ...}}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/credentials.go:194 +0x147 fp=0xc025b2c540 sp=0xc025b2c148 pc=0x9a4f87
github.com/aws/aws-sdk-go/aws/session.resolveCredsFromProfile(_, {{{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, {0xc000028193, ...}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/credentials.go:138 +0x25b fp=0xc025b2d2c0 sp=0xc025b2c540 pc=0x9a467b
github.com/aws/aws-sdk-go/aws/session.resolveCredsFromProfile(_, {{{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, {0xc000028193, ...}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/credentials.go:111 +0x8be fp=0xc025b2e040 sp=0xc025b2d2c0 pc=0x9a4cde
github.com/aws/aws-sdk-go/aws/session.resolveCredentials(_, {{{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, {0xc000028193, ...}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/credentials.go:62 +0x2be fp=0xc025b2e960 sp=0xc025b2e040 pc=0x9a3f1e
github.com/aws/aws-sdk-go/aws/session.mergeConfigSrcs(_, _, {{{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/session.go:808 +0x7c5 fp=0xc025b2f2d0 sp=0xc025b2e960 pc=0x9ab765
github.com/aws/aws-sdk-go/aws/session.newSession({{0x0, 0x0, 0x0, {0x0, 0x0}, 0x0, 0x0, 0x0, 0x0, 0x0, ...}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/session.go:498 +0x4ae fp=0xc025b30340 sp=0xc025b2f2d0 pc=0x9a8f2e
github.com/aws/aws-sdk-go/aws/session.NewSessionWithOptions({{0x0, 0x0, 0x0, {0x0, 0x0}, 0x0, 0x0, 0x0, 0x0, 0x0, ...}, ...})
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/session.go:368 +0x348 fp=0xc025b30b78 sp=0xc025b30340 pc=0x9a8088
github.com/aws/aws-sdk-go/aws/session.NewSession({0x0, 0x0, 0x0?})
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/session.go:152 +0xb8 fp=0xc025b31250 sp=0xc025b30b78 pc=0x9a7cf8
github.com/aws/aws-sdk-go/aws/session.resolveSSOCredentials(_, {{0xc021e76900, 0x9}, {{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, ...}}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/credentials.go:194 +0x147 fp=0xc025b31648 sp=0xc025b31250 pc=0x9a4f87
github.com/aws/aws-sdk-go/aws/session.resolveCredsFromProfile(_, {{{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, {0xc000028193, ...}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/credentials.go:138 +0x25b fp=0xc025b323c8 sp=0xc025b31648 pc=0x9a467b
github.com/aws/aws-sdk-go/aws/session.resolveCredsFromProfile(_, {{{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, {0xc000028193, ...}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/credentials.go:111 +0x8be fp=0xc025b33148 sp=0xc025b323c8 pc=0x9a4cde
github.com/aws/aws-sdk-go/aws/session.resolveCredentials(_, {{{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, {0xc000028193, ...}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/credentials.go:62 +0x2be fp=0xc025b33a68 sp=0xc025b33148 pc=0x9a3f1e
github.com/aws/aws-sdk-go/aws/session.mergeConfigSrcs(_, _, {{{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/session.go:808 +0x7c5 fp=0xc025b343d8 sp=0xc025b33a68 pc=0x9ab765
github.com/aws/aws-sdk-go/aws/session.newSession({{0x0, 0x0, 0x0, {0x0, 0x0}, 0x0, 0x0, 0x0, 0x0, 0x0, ...}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/session.go:498 +0x4ae fp=0xc025b35448 sp=0xc025b343d8 pc=0x9a8f2e
github.com/aws/aws-sdk-go/aws/session.NewSessionWithOptions({{0x0, 0x0, 0x0, {0x0, 0x0}, 0x0, 0x0, 0x0, 0x0, 0x0, ...}, ...})
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/session.go:368 +0x348 fp=0xc025b35c80 sp=0xc025b35448 pc=0x9a8088
github.com/aws/aws-sdk-go/aws/session.NewSession({0x0, 0x0, 0x0?})
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/session.go:152 +0xb8 fp=0xc025b36358 sp=0xc025b35c80 pc=0x9a7cf8
github.com/aws/aws-sdk-go/aws/session.resolveSSOCredentials(_, {{0xc021d9fe10, 0x9}, {{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, ...}}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/credentials.go:194 +0x147 fp=0xc025b36750 sp=0xc025b36358 pc=0x9a4f87
github.com/aws/aws-sdk-go/aws/session.resolveCredsFromProfile(_, {{{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, {0xc000028193, ...}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/credentials.go:138 +0x25b fp=0xc025b374d0 sp=0xc025b36750 pc=0x9a467b
github.com/aws/aws-sdk-go/aws/session.resolveCredsFromProfile(_, {{{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, {0xc000028193, ...}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/credentials.go:111 +0x8be fp=0xc025b38250 sp=0xc025b374d0 pc=0x9a4cde
github.com/aws/aws-sdk-go/aws/session.resolveCredentials(_, {{{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, {0xc000028193, ...}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/credentials.go:62 +0x2be fp=0xc025b38b70 sp=0xc025b38250 pc=0x9a3f1e
github.com/aws/aws-sdk-go/aws/session.mergeConfigSrcs(_, _, {{{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/session.go:808 +0x7c5 fp=0xc025b394e0 sp=0xc025b38b70 pc=0x9ab765
github.com/aws/aws-sdk-go/aws/session.newSession({{0x0, 0x0, 0x0, {0x0, 0x0}, 0x0, 0x0, 0x0, 0x0, 0x0, ...}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/session.go:498 +0x4ae fp=0xc025b3a550 sp=0xc025b394e0 pc=0x9a8f2e
github.com/aws/aws-sdk-go/aws/session.NewSessionWithOptions({{0x0, 0x0, 0x0, {0x0, 0x0}, 0x0, 0x0, 0x0, 0x0, 0x0, ...}, ...})
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/session.go:368 +0x348 fp=0xc025b3ad88 sp=0xc025b3a550 pc=0x9a8088
github.com/aws/aws-sdk-go/aws/session.NewSession({0x0, 0x0, 0x0?})
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/session.go:152 +0xb8 fp=0xc025b3b460 sp=0xc025b3ad88 pc=0x9a7cf8
github.com/aws/aws-sdk-go/aws/session.resolveSSOCredentials(_, {{0xc021d9f310, 0x9}, {{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, ...}}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/credentials.go:194 +0x147 fp=0xc025b3b858 sp=0xc025b3b460 pc=0x9a4f87
github.com/aws/aws-sdk-go/aws/session.resolveCredsFromProfile(_, {{{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, {0xc000028193, ...}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/credentials.go:138 +0x25b fp=0xc025b3c5d8 sp=0xc025b3b858 pc=0x9a467b
github.com/aws/aws-sdk-go/aws/session.resolveCredsFromProfile(_, {{{0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}, {0x0, 0x0}}, {0xc000028193, ...}, ...}, ...)
	github.com/aws/aws-sdk-go@v1.44.298/aws/session/credentials.go:111 +0x8be fp=0xc025b3d358 sp=0xc025b3c5d8 pc=0x9a4cde
...additional frames elided...

goroutine 2 [force gc (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:381 +0xd6 fp=0xc00006afb0 sp=0xc00006af90 pc=0x437e16
runtime.goparkunlock(...)
	runtime/proc.go:387
runtime.forcegchelper()
	runtime/proc.go:305 +0xb0 fp=0xc00006afe0 sp=0xc00006afb0 pc=0x437c50
runtime.goexit()
	runtime/asm_amd64.s:1598 +0x1 fp=0xc00006afe8 sp=0xc00006afe0 pc=0x466e01
created by runtime.init.6
	runtime/proc.go:293 +0x25

goroutine 3 [GC sweep wait]:
runtime.gopark(0x1?, 0x0?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:381 +0xd6 fp=0xc00006b780 sp=0xc00006b760 pc=0x437e16
runtime.goparkunlock(...)
	runtime/proc.go:387
runtime.bgsweep(0x0?)
	runtime/mgcsweep.go:319 +0xde fp=0xc00006b7c8 sp=0xc00006b780 pc=0x42405e
runtime.gcenable.func1()
	runtime/mgc.go:178 +0x26 fp=0xc00006b7e0 sp=0xc00006b7c8 pc=0x4192c6
runtime.goexit()
	runtime/asm_amd64.s:1598 +0x1 fp=0xc00006b7e8 sp=0xc00006b7e0 pc=0x466e01
created by runtime.gcenable
	runtime/mgc.go:178 +0x6b

goroutine 4 [GC scavenge wait]:
runtime.gopark(0x51a3fb6f2e0?, 0x8c3978?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:381 +0xd6 fp=0xc00006bf70 sp=0xc00006bf50 pc=0x437e16
runtime.goparkunlock(...)
	runtime/proc.go:387
runtime.(*scavengerState).park(0x1612940)
	runtime/mgcscavenge.go:400 +0x53 fp=0xc00006bfa0 sp=0xc00006bf70 pc=0x421f33
runtime.bgscavenge(0x0?)
	runtime/mgcscavenge.go:633 +0x65 fp=0xc00006bfc8 sp=0xc00006bfa0 pc=0x422525
runtime.gcenable.func2()
	runtime/mgc.go:179 +0x26 fp=0xc00006bfe0 sp=0xc00006bfc8 pc=0x419266
runtime.goexit()
	runtime/asm_amd64.s:1598 +0x1 fp=0xc00006bfe8 sp=0xc00006bfe0 pc=0x466e01
created by runtime.gcenable
	runtime/mgc.go:179 +0xaa

goroutine 5 [finalizer wait]:
runtime.gopark(0x438192?, 0x437b85?, 0x0?, 0x0?, 0xc00006a770?)
	runtime/proc.go:381 +0xd6 fp=0xc00006a628 sp=0xc00006a608 pc=0x437e16
runtime.runfinq()
	runtime/mfinal.go:193 +0x107 fp=0xc00006a7e0 sp=0xc00006a628 pc=0x418307
runtime.goexit()
	runtime/asm_amd64.s:1598 +0x1 fp=0xc00006a7e8 sp=0xc00006a7e0 pc=0x466e01
created by runtime.createfing
	runtime/mfinal.go:163 +0x45

goroutine 6 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:381 +0xd6 fp=0xc00006c750 sp=0xc00006c730 pc=0x437e16
runtime.gcBgMarkWorker()
	runtime/mgc.go:1275 +0xf1 fp=0xc00006c7e0 sp=0xc00006c750 pc=0x41b031
runtime.goexit()
	runtime/asm_amd64.s:1598 +0x1 fp=0xc00006c7e8 sp=0xc00006c7e0 pc=0x466e01
created by runtime.gcBgMarkStartWorkers
	runtime/mgc.go:1199 +0x25

goroutine 17 [GC worker (idle)]:
runtime.gopark(0x51ab413d65c?, 0x1?, 0x2c?, 0x5e?, 0x0?)
	runtime/proc.go:381 +0xd6 fp=0xc000066750 sp=0xc000066730 pc=0x437e16
runtime.gcBgMarkWorker()
	runtime/mgc.go:1275 +0xf1 fp=0xc0000667e0 sp=0xc000066750 pc=0x41b031
runtime.goexit()
	runtime/asm_amd64.s:1598 +0x1 fp=0xc0000667e8 sp=0xc0000667e0 pc=0x466e01
created by runtime.gcBgMarkStartWorkers
	runtime/mgc.go:1199 +0x25

goroutine 18 [GC worker (idle)]:
runtime.gopark(0x1642ac0?, 0x3?, 0xc8?, 0x39?, 0x0?)
	runtime/proc.go:381 +0xd6 fp=0xc000066f50 sp=0xc000066f30 pc=0x437e16
runtime.gcBgMarkWorker()
	runtime/mgc.go:1275 +0xf1 fp=0xc000066fe0 sp=0xc000066f50 pc=0x41b031
runtime.goexit()
	runtime/asm_amd64.s:1598 +0x1 fp=0xc000066fe8 sp=0xc000066fe0 pc=0x466e01
created by runtime.gcBgMarkStartWorkers
	runtime/mgc.go:1199 +0x25

goroutine 19 [GC worker (idle)]:
runtime.gopark(0x1642ac0?, 0x1?, 0x9d?, 0x78?, 0x0?)
	runtime/proc.go:381 +0xd6 fp=0xc000067750 sp=0xc000067730 pc=0x437e16
runtime.gcBgMarkWorker()
	runtime/mgc.go:1275 +0xf1 fp=0xc0000677e0 sp=0xc000067750 pc=0x41b031
runtime.goexit()
	runtime/asm_amd64.s:1598 +0x1 fp=0xc0000677e8 sp=0xc0000677e0 pc=0x466e01
created by runtime.gcBgMarkStartWorkers
	runtime/mgc.go:1199 +0x25

goroutine 20 [GC worker (idle)]:
runtime.gopark(0x1642ac0?, 0x1?, 0x29?, 0x84?, 0x0?)
	runtime/proc.go:381 +0xd6 fp=0xc000067f50 sp=0xc000067f30 pc=0x437e16
runtime.gcBgMarkWorker()
	runtime/mgc.go:1275 +0xf1 fp=0xc000067fe0 sp=0xc000067f50 pc=0x41b031
runtime.goexit()
	runtime/asm_amd64.s:1598 +0x1 fp=0xc000067fe8 sp=0xc000067fe0 pc=0x466e01
created by runtime.gcBgMarkStartWorkers
	runtime/mgc.go:1199 +0x25

goroutine 21 [GC worker (idle)]:
runtime.gopark(0x51ab413edec?, 0x1?, 0x2?, 0xb5?, 0x0?)
	runtime/proc.go:381 +0xd6 fp=0xc000068750 sp=0xc000068730 pc=0x437e16
runtime.gcBgMarkWorker()
	runtime/mgc.go:1275 +0xf1 fp=0xc0000687e0 sp=0xc000068750 pc=0x41b031
runtime.goexit()
	runtime/asm_amd64.s:1598 +0x1 fp=0xc0000687e8 sp=0xc0000687e0 pc=0x466e01
created by runtime.gcBgMarkStartWorkers
	runtime/mgc.go:1199 +0x25

goroutine 22 [GC worker (idle)]:
runtime.gopark(0x51ab413ea3f?, 0x1?, 0x26?, 0x51?, 0x0?)
	runtime/proc.go:381 +0xd6 fp=0xc000068f50 sp=0xc000068f30 pc=0x437e16
runtime.gcBgMarkWorker()
	runtime/mgc.go:1275 +0xf1 fp=0xc000068fe0 sp=0xc000068f50 pc=0x41b031
runtime.goexit()
	runtime/asm_amd64.s:1598 +0x1 fp=0xc000068fe8 sp=0xc000068fe0 pc=0x466e01
created by runtime.gcBgMarkStartWorkers
	runtime/mgc.go:1199 +0x25

goroutine 23 [GC worker (idle)]:
runtime.gopark(0x51ab4172cb1?, 0x3?, 0x9?, 0x2?, 0x0?)
	runtime/proc.go:381 +0xd6 fp=0xc000069750 sp=0xc000069730 pc=0x437e16
runtime.gcBgMarkWorker()
	runtime/mgc.go:1275 +0xf1 fp=0xc0000697e0 sp=0xc000069750 pc=0x41b031
runtime.goexit()
	runtime/asm_amd64.s:1598 +0x1 fp=0xc0000697e8 sp=0xc0000697e0 pc=0x466e01
created by runtime.gcBgMarkStartWorkers
	runtime/mgc.go:1199 +0x25

goroutine 24 [GC worker (idle)]:
runtime.gopark(0x51ab413eadd?, 0x1?, 0xd5?, 0x9c?, 0x0?)
	runtime/proc.go:381 +0xd6 fp=0xc000069f50 sp=0xc000069f30 pc=0x437e16
runtime.gcBgMarkWorker()
	runtime/mgc.go:1275 +0xf1 fp=0xc000069fe0 sp=0xc000069f50 pc=0x41b031
runtime.goexit()
	runtime/asm_amd64.s:1598 +0x1 fp=0xc000069fe8 sp=0xc000069fe0 pc=0x466e01
created by runtime.gcBgMarkStartWorkers
	runtime/mgc.go:1199 +0x25

goroutine 25 [GC worker (idle)]:
runtime.gopark(0x51ab4172721?, 0x1?, 0xa8?, 0x62?, 0x0?)
	runtime/proc.go:381 +0xd6 fp=0xc00011c750 sp=0xc00011c730 pc=0x437e16
runtime.gcBgMarkWorker()
	runtime/mgc.go:1275 +0xf1 fp=0xc00011c7e0 sp=0xc00011c750 pc=0x41b031
runtime.goexit()
	runtime/asm_amd64.s:1598 +0x1 fp=0xc00011c7e8 sp=0xc00011c7e0 pc=0x466e01
created by runtime.gcBgMarkStartWorkers
	runtime/mgc.go:1199 +0x25

goroutine 26 [GC worker (idle)]:
runtime.gopark(0x51ab413ed8c?, 0x1?, 0x38?, 0xe6?, 0x0?)
	runtime/proc.go:381 +0xd6 fp=0xc00011cf50 sp=0xc00011cf30 pc=0x437e16
runtime.gcBgMarkWorker()
	runtime/mgc.go:1275 +0xf1 fp=0xc00011cfe0 sp=0xc00011cf50 pc=0x41b031
runtime.goexit()
	runtime/asm_amd64.s:1598 +0x1 fp=0xc00011cfe8 sp=0xc00011cfe0 pc=0x466e01
created by runtime.gcBgMarkStartWorkers
	runtime/mgc.go:1199 +0x25

goroutine 27 [GC worker (idle)]:
runtime.gopark(0x51ab413d897?, 0x3?, 0xd3?, 0x5?, 0x0?)
	runtime/proc.go:381 +0xd6 fp=0xc00011d750 sp=0xc00011d730 pc=0x437e16
runtime.gcBgMarkWorker()
	runtime/mgc.go:1275 +0xf1 fp=0xc00011d7e0 sp=0xc00011d750 pc=0x41b031
runtime.goexit()
	runtime/asm_amd64.s:1598 +0x1 fp=0xc00011d7e8 sp=0xc00011d7e0 pc=0x466e01
created by runtime.gcBgMarkStartWorkers
	runtime/mgc.go:1199 +0x25

goroutine 28 [GC worker (idle)]:
runtime.gopark(0x51ab41726a0?, 0x3?, 0x55?, 0xdf?, 0x0?)
	runtime/proc.go:381 +0xd6 fp=0xc00011df50 sp=0xc00011df30 pc=0x437e16
runtime.gcBgMarkWorker()
	runtime/mgc.go:1275 +0xf1 fp=0xc00011dfe0 sp=0xc00011df50 pc=0x41b031
runtime.goexit()
	runtime/asm_amd64.s:1598 +0x1 fp=0xc00011dfe8 sp=0xc00011dfe0 pc=0x466e01
created by runtime.gcBgMarkStartWorkers
	runtime/mgc.go:1199 +0x25

goroutine 29 [GC worker (idle)]:
runtime.gopark(0x51ab417259e?, 0x3?, 0xea?, 0x2c?, 0x0?)
	runtime/proc.go:381 +0xd6 fp=0xc00011e750 sp=0xc00011e730 pc=0x437e16
runtime.gcBgMarkWorker()
	runtime/mgc.go:1275 +0xf1 fp=0xc00011e7e0 sp=0xc00011e750 pc=0x41b031
runtime.goexit()
	runtime/asm_amd64.s:1598 +0x1 fp=0xc00011e7e8 sp=0xc00011e7e0 pc=0x466e01
created by runtime.gcBgMarkStartWorkers
	runtime/mgc.go:1199 +0x25

goroutine 30 [GC worker (idle)]:
runtime.gopark(0x51ab41725d5?, 0x3?, 0xe5?, 0x10?, 0x0?)
	runtime/proc.go:381 +0xd6 fp=0xc00011ef50 sp=0xc00011ef30 pc=0x437e16
runtime.gcBgMarkWorker()
	runtime/mgc.go:1275 +0xf1 fp=0xc00011efe0 sp=0xc00011ef50 pc=0x41b031
runtime.goexit()
	runtime/asm_amd64.s:1598 +0x1 fp=0xc00011efe8 sp=0xc00011efe0 pc=0x466e01
created by runtime.gcBgMarkStartWorkers
	runtime/mgc.go:1199 +0x25

goroutine 7 [GC worker (idle)]:
runtime.gopark(0x51ab413eb61?, 0x1?, 0xb3?, 0x36?, 0x0?)
	runtime/proc.go:381 +0xd6 fp=0xc00006cf50 sp=0xc00006cf30 pc=0x437e16
runtime.gcBgMarkWorker()
	runtime/mgc.go:1275 +0xf1 fp=0xc00006cfe0 sp=0xc00006cf50 pc=0x41b031
runtime.goexit()
	runtime/asm_amd64.s:1598 +0x1 fp=0xc00006cfe8 sp=0xc00006cfe0 pc=0x466e01
created by runtime.gcBgMarkStartWorkers
	runtime/mgc.go:1199 +0x25

@alecjacobs5401
Copy link
Contributor

Hmm, alright. It looks like that might be coming from internals of the aws-sdk-go package.

We unfortunately don't have the configuration to test this out currently and it might take some time to get running. If you want to continue digging and end up finding a fix, we'd be happy to accept a contribution.

@alecjacobs5401
Copy link
Contributor

alecjacobs5401 commented Jul 31, 2023 •
edited

Hey @jim-barber-he, I just merged in #411 which included the following bug fix from the aws-sdk-go package:

SDK Bugs
aws/session: Modify resolving sso credential logic to fix stack overflow bug while configuring shared config profile via env var.

(Related Issue: aws/aws-sdk-go#4912)

Do you mind trying a local build off of latest master and see if it resolves your issue? If it does, I can craft a release

@jim-barber-he
Copy link
Author

jim-barber-he commented Aug 1, 2023 •
edited

Yep it looks good:

$ ./chamber version 
chamber v2.13.2-1-g84f2d5d

$ AWS_PROFILE=test ./chamber list test/common
Key					Version		LastModified		User
aws_account_alias			0		2022-11-17 07:37:30	REDACTED
aws_account_id				0		2022-11-17 07:37:30	REDACTED

vs the other one I have that is broken (not using ./ when running it so it is choosing the one in my PATH):

$ chamber version                               
chamber v2.13.2

$ AWS_PROFILE=test chamber list test/common
runtime: goroutine stack exceeds 1000000000-byte limit
runtime: sp=0xc025c81470 stack=[0xc025c80000, 0xc045c80000]
fatal error: stack overflow
.
.
.

@alecjacobs5401
Copy link
Contributor

@jim-barber-he Great! I'll trigger a release then

@alecjacobs5401
Copy link
Contributor

Closing this as done thanks to https://github.com/segmentio/chamber/releases/tag/v2.13.3

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@alecjacobs5401 @jim-barber-he