Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

cp-quickstart fails to complete cluster setup with errors #1133

Open
JakeBogie opened this issue Oct 24, 2022 · 0 comments
Open

cp-quickstart fails to complete cluster setup with errors #1133

JakeBogie opened this issue Oct 24, 2022 · 0 comments

Comments

@JakeBogie
Copy link
Member

Description
When creating a cluster in Azure using cp-quickstart/start-cloud.sh the script completes with errors, and the cluster is not completely set up. In some cases the cluster gets created, yet the datagen connectors do not get created. In other instances the connectors get created and the ksql persistent queries do not get created.

The error in console output in both cases indicates:

panic: runtime error: index out of range [0] with length 0

I have included full console output from two runs of the script with their errors. They are below.

Environment

  • GitHub branch: 7.2.2-post
  • Operating System: macOS Monterey 12.6
~/w/local-repo/confluent-examples/cp-quickstart 7.2.2-post !1 ❯ ./start-cloud.sh                                                               11:44:52
✔ jq found

====== Confirm


--------------------------------------------------------------------------------------------
This example runs on Confluent Cloud, sign up here:

         https://www.confluent.io/confluent-cloud/tryfree/

The example uses real Confluent Cloud resources that may be billable, including connectors
and ksqlDB applications that may have hourly charges. The end of this script shows a command
you can run to destroy all the cloud resources, and you should verify they are destroyed.

New Confluent Cloud signups receive $400 to spend within Confluent Cloud during their first
60 days. Use Confluent Cloud promo code C50INTEG to receive an additional $50 free usage.
This will sufficiently cover one day of running this example, beyond which you may be billed
for the Confluent Cloud resources until you destroy them.
--------------------------------------------------------------------------------------------

Do you still want to run this script? [y/n] y
Do you acknowledge this script creates a Confluent Cloud KSQL app (hourly charges may apply)? [y/n] y
✔ Confluent CLI version ok
✔ Logged into the Confluent CLI
✔ Prerequisite check pass

For your reference the demo will highlight some commands in code format

====== Starting


====== Creating new Confluent Cloud stack using the ccloud::create_ccloud_stack function
See: https://github.com/confluentinc/examples/blob/7.2.2-post/utils/ccloud_library.sh for details
Creating Confluent Cloud stack for service account demo-app-1050, ID: sa-r5pop1.

Waiting up to 720 seconds for Confluent Cloud cluster to be ready and for credentials to propagate

Sleeping an additional 80 seconds to ensure propagation of all metadata

    Principal    | Permission | Operation | Resource Type | Resource Name | Pattern Type
-----------------+------------+-----------+---------------+---------------+---------------
  User:sa-r5pop1 | ALLOW      | CREATE    | TOPIC         | *             | LITERAL
    Principal    | Permission | Operation | Resource Type | Resource Name | Pattern Type
-----------------+------------+-----------+---------------+---------------+---------------
  User:sa-r5pop1 | ALLOW      | DELETE    | TOPIC         | *             | LITERAL
    Principal    | Permission | Operation | Resource Type | Resource Name | Pattern Type
-----------------+------------+-----------+---------------+---------------+---------------
  User:sa-r5pop1 | ALLOW      | WRITE     | TOPIC         | *             | LITERAL
    Principal    | Permission | Operation | Resource Type | Resource Name | Pattern Type
-----------------+------------+-----------+---------------+---------------+---------------
  User:sa-r5pop1 | ALLOW      | READ      | TOPIC         | *             | LITERAL
    Principal    | Permission | Operation | Resource Type | Resource Name | Pattern Type
-----------------+------------+-----------+---------------+---------------+---------------
  User:sa-r5pop1 | ALLOW      | DESCRIBE  | TOPIC         | *             | LITERAL
    Principal    | Permission |    Operation     | Resource Type | Resource Name | Pattern Type
-----------------+------------+------------------+---------------+---------------+---------------
  User:sa-r5pop1 | ALLOW      | DESCRIBE_CONFIGS | TOPIC         | *             | LITERAL
    Principal    | Permission | Operation | Resource Type | Resource Name | Pattern Type
-----------------+------------+-----------+---------------+---------------+---------------
  User:sa-r5pop1 | ALLOW      | READ      | GROUP         | *             | LITERAL
    Principal    | Permission | Operation | Resource Type | Resource Name | Pattern Type
-----------------+------------+-----------+---------------+---------------+---------------
  User:sa-r5pop1 | ALLOW      | WRITE     | GROUP         | *             | LITERAL
    Principal    | Permission | Operation | Resource Type | Resource Name | Pattern Type
-----------------+------------+-----------+---------------+---------------+---------------
  User:sa-r5pop1 | ALLOW      | CREATE    | GROUP         | *             | LITERAL
    Principal    | Permission | Operation | Resource Type | Resource Name | Pattern Type
-----------------+------------+-----------+---------------+---------------+---------------
  User:sa-r5pop1 | ALLOW      | DESCRIBE  | GROUP         | *             | LITERAL
    Principal    | Permission | Operation |  Resource Type   | Resource Name | Pattern Type
-----------------+------------+-----------+------------------+---------------+---------------
  User:sa-r5pop1 | ALLOW      | DESCRIBE  | TRANSACTIONAL_ID | *             | LITERAL
    Principal    | Permission | Operation |  Resource Type   | Resource Name | Pattern Type
-----------------+------------+-----------+------------------+---------------+---------------
  User:sa-r5pop1 | ALLOW      | WRITE     | TRANSACTIONAL_ID | *             | LITERAL
    Principal    | Permission |    Operation     | Resource Type | Resource Name | Pattern Type
-----------------+------------+------------------+---------------+---------------+---------------
  User:sa-r5pop1 | ALLOW      | IDEMPOTENT_WRITE | CLUSTER       | kafka-cluster | LITERAL
    Principal    | Permission | Operation | Resource Type | Resource Name | Pattern Type
-----------------+------------+-----------+---------------+---------------+---------------
  User:sa-r5pop1 | ALLOW      | DESCRIBE  | CLUSTER       | kafka-cluster | LITERAL
panic: runtime error: index out of range [0] with length 0

goroutine 1 [running]:
github.com/confluentinc/cli/internal/cmd/ksql.getCreateAclRequestDataList({0xc000aa4500, 0x20, 0xc000a4a480?})
	go/src/github.com/confluentinc/cli/internal/cmd/ksql/command_configureacls.go:184 +0x9d
github.com/confluentinc/cli/internal/cmd/ksql.(*ksqlCommand).configureACLs(0xc000616848, 0x20?, {0xc000408f80, 0x1, 0x1})
	go/src/github.com/confluentinc/cli/internal/cmd/ksql/command_configureacls.go:82 +0x3c8
github.com/confluentinc/cli/internal/pkg/cmd.Chain.func1(0xc000617370?, {0xc000408f80, 0x1, 0x1})
	go/src/github.com/confluentinc/cli/internal/pkg/cmd/cobra.go:24 +0x7f
github.com/confluentinc/cli/internal/pkg/cmd.CatchErrors.func1(0xc0008b3900, {0xc000408f80, 0x1, 0x1})
	go/src/github.com/confluentinc/cli/internal/pkg/cmd/cobra.go:12 +0x69
github.com/spf13/cobra.(*Command).execute(0xc0008b3900, {0xc000408f60, 0x1, 0x1})
	go/1.19.0/pkg/mod/github.com/spf13/cobra@v1.5.0/command.go:872 +0x694
github.com/spf13/cobra.(*Command).ExecuteC(0xc0001fcc80)
	go/1.19.0/pkg/mod/github.com/spf13/cobra@v1.5.0/command.go:990 +0x3bd
github.com/spf13/cobra.(*Command).Execute(...)
	go/1.19.0/pkg/mod/github.com/spf13/cobra@v1.5.0/command.go:918
github.com/confluentinc/cli/internal/cmd.Execute(0xc0001fcc80, {0xc0000520b0?, 0x6691478?, 0x8?}, 0xc00025e090)
	go/src/github.com/confluentinc/cli/internal/cmd/command.go:150 +0x1f7
main.main()
	go/src/github.com/confluentinc/cli/cmd/confluent/main.go:37 +0x28a
Set API Key "4BO4HQXPRAV7DPNN" as the active API key for "lkc-j563ww".

Client configuration file saved to: stack-configs/java-service-account-sa-r5pop1.config
✔ cccloud::create_ccloud_stack true
grep: stack-configs/java-service-account--.config: No such file or directory
ERROR: Cannot read the 'bootstrap.servers' key-value pair from stack-configs/java-service-account--.config.

~/w/l/confluent-examples/cp-quickstart 7.2.2-post !1 ❯

And the output of the second run with errors:

~/w/l/confluent-examples/cp-quickstart 7.2.2-post !1 ❯ ./start-cloud.sh                                                                    24s 12:04:04
✔ jq found

====== Confirm


--------------------------------------------------------------------------------------------
This example runs on Confluent Cloud, sign up here:

         https://www.confluent.io/confluent-cloud/tryfree/

The example uses real Confluent Cloud resources that may be billable, including connectors
and ksqlDB applications that may have hourly charges. The end of this script shows a command
you can run to destroy all the cloud resources, and you should verify they are destroyed.

New Confluent Cloud signups receive $400 to spend within Confluent Cloud during their first
60 days. Use Confluent Cloud promo code C50INTEG to receive an additional $50 free usage.
This will sufficiently cover one day of running this example, beyond which you may be billed
for the Confluent Cloud resources until you destroy them.
--------------------------------------------------------------------------------------------

Do you still want to run this script? [y/n] y
Do you acknowledge this script creates a Confluent Cloud KSQL app (hourly charges may apply)? [y/n] y
✔ Confluent CLI version ok
✔ Logged into the Confluent CLI
✔ Prerequisite check pass

For your reference the demo will highlight some commands in code format

====== Starting


====== Creating new Confluent Cloud stack using the ccloud::create_ccloud_stack function
See: https://github.com/confluentinc/examples/blob/7.2.2-post/utils/ccloud_library.sh for details
Creating Confluent Cloud stack for service account demo-app-5190, ID: sa-r5pxr9.

Waiting up to 720 seconds for Confluent Cloud cluster to be ready and for credentials to propagate

Sleeping an additional 80 seconds to ensure propagation of all metadata

    Principal    | Permission | Operation | Resource Type | Resource Name | Pattern Type
-----------------+------------+-----------+---------------+---------------+---------------
  User:sa-r5pxr9 | ALLOW      | CREATE    | TOPIC         | *             | LITERAL
    Principal    | Permission | Operation | Resource Type | Resource Name | Pattern Type
-----------------+------------+-----------+---------------+---------------+---------------
  User:sa-r5pxr9 | ALLOW      | DELETE    | TOPIC         | *             | LITERAL
    Principal    | Permission | Operation | Resource Type | Resource Name | Pattern Type
-----------------+------------+-----------+---------------+---------------+---------------
  User:sa-r5pxr9 | ALLOW      | WRITE     | TOPIC         | *             | LITERAL
    Principal    | Permission | Operation | Resource Type | Resource Name | Pattern Type
-----------------+------------+-----------+---------------+---------------+---------------
  User:sa-r5pxr9 | ALLOW      | READ      | TOPIC         | *             | LITERAL
    Principal    | Permission | Operation | Resource Type | Resource Name | Pattern Type
-----------------+------------+-----------+---------------+---------------+---------------
  User:sa-r5pxr9 | ALLOW      | DESCRIBE  | TOPIC         | *             | LITERAL
    Principal    | Permission |    Operation     | Resource Type | Resource Name | Pattern Type
-----------------+------------+------------------+---------------+---------------+---------------
  User:sa-r5pxr9 | ALLOW      | DESCRIBE_CONFIGS | TOPIC         | *             | LITERAL
    Principal    | Permission | Operation | Resource Type | Resource Name | Pattern Type
-----------------+------------+-----------+---------------+---------------+---------------
  User:sa-r5pxr9 | ALLOW      | READ      | GROUP         | *             | LITERAL
    Principal    | Permission | Operation | Resource Type | Resource Name | Pattern Type
-----------------+------------+-----------+---------------+---------------+---------------
  User:sa-r5pxr9 | ALLOW      | WRITE     | GROUP         | *             | LITERAL
    Principal    | Permission | Operation | Resource Type | Resource Name | Pattern Type
-----------------+------------+-----------+---------------+---------------+---------------
  User:sa-r5pxr9 | ALLOW      | CREATE    | GROUP         | *             | LITERAL
    Principal    | Permission | Operation | Resource Type | Resource Name | Pattern Type
-----------------+------------+-----------+---------------+---------------+---------------
  User:sa-r5pxr9 | ALLOW      | DESCRIBE  | GROUP         | *             | LITERAL
    Principal    | Permission | Operation |  Resource Type   | Resource Name | Pattern Type
-----------------+------------+-----------+------------------+---------------+---------------
  User:sa-r5pxr9 | ALLOW      | DESCRIBE  | TRANSACTIONAL_ID | *             | LITERAL
    Principal    | Permission | Operation |  Resource Type   | Resource Name | Pattern Type
-----------------+------------+-----------+------------------+---------------+---------------
  User:sa-r5pxr9 | ALLOW      | WRITE     | TRANSACTIONAL_ID | *             | LITERAL
    Principal    | Permission |    Operation     | Resource Type | Resource Name | Pattern Type
-----------------+------------+------------------+---------------+---------------+---------------
  User:sa-r5pxr9 | ALLOW      | IDEMPOTENT_WRITE | CLUSTER       | kafka-cluster | LITERAL
    Principal    | Permission | Operation | Resource Type | Resource Name | Pattern Type
-----------------+------------+-----------+---------------+---------------+---------------
  User:sa-r5pxr9 | ALLOW      | DESCRIBE  | CLUSTER       | kafka-cluster | LITERAL
panic: runtime error: index out of range [0] with length 0

goroutine 1 [running]:
github.com/confluentinc/cli/internal/cmd/ksql.getCreateAclRequestDataList({0xc000b8e500, 0x20, 0xc0008da480?})
	go/src/github.com/confluentinc/cli/internal/cmd/ksql/command_configureacls.go:184 +0x9d
github.com/confluentinc/cli/internal/cmd/ksql.(*ksqlCommand).configureACLs(0xc000014bc0, 0x20?, {0xc00037a510, 0x1, 0x1})
	go/src/github.com/confluentinc/cli/internal/cmd/ksql/command_configureacls.go:82 +0x3c8
github.com/confluentinc/cli/internal/pkg/cmd.Chain.func1(0xc000015528?, {0xc00037a510, 0x1, 0x1})
	go/src/github.com/confluentinc/cli/internal/pkg/cmd/cobra.go:24 +0x7f
github.com/confluentinc/cli/internal/pkg/cmd.CatchErrors.func1(0xc0003e9b80, {0xc00037a510, 0x1, 0x1})
	go/src/github.com/confluentinc/cli/internal/pkg/cmd/cobra.go:12 +0x69
github.com/spf13/cobra.(*Command).execute(0xc0003e9b80, {0xc00037a4f0, 0x1, 0x1})
	go/1.19.0/pkg/mod/github.com/spf13/cobra@v1.5.0/command.go:872 +0x694
github.com/spf13/cobra.(*Command).ExecuteC(0xc000004280)
	go/1.19.0/pkg/mod/github.com/spf13/cobra@v1.5.0/command.go:990 +0x3bd
github.com/spf13/cobra.(*Command).Execute(...)
	go/1.19.0/pkg/mod/github.com/spf13/cobra@v1.5.0/command.go:918
github.com/confluentinc/cli/internal/cmd.Execute(0xc000004280, {0xc000114060?, 0x6691478?, 0x8?}, 0xc0001d0120)
	go/src/github.com/confluentinc/cli/internal/cmd/command.go:150 +0x1f7
main.main()
	go/src/github.com/confluentinc/cli/cmd/confluent/main.go:37 +0x28a
Set API Key "STEKJZQBC4QXBQB7" as the active API key for "lkc-nv7w6v".

Client configuration file saved to: stack-configs/java-service-account-sa-r5pxr9.config
✔ cccloud::create_ccloud_stack true

Generating component configurations from stack-configs/java-service-account-sa-r5pxr9.config and saving to the folder delta_configs

✔ ccloud::generate_configs stack-configs/java-service-account-sa-r5pxr9.config

Setting local environment based on values in delta_configs/env.delta
✔ source delta_configs/env.delta
Set Kafka cluster "lkc-nv7w6v" as the active cluster for environment "env-yo1wo7".

Associated key STEKJZQBC4QXBQB7 to Confluent Cloud Kafka cluster lkc-nv7w6v at pkc-lgwgm.eastus2.azure.confluent.cloud:9092
Validated credentials to Confluent Cloud Schema Registry at https://psrc-3508o.westus2.azure.confluent.cloud

⌛ ====== Pre-creating topics
Created topic "pageviews".
✔ confluent kafka topic create pageviews
Created topic "users".
✔ confluent kafka topic create users
✔ Topics created

⌛ ====== Create fully-managed Datagen Source Connectors to produce sample data.

Creating connector from connectors/ccloud-datagen-pageviews.json

2022-10-24T12:07:57.460-0400 [DEBUG] Recursively searching $PATH for plugins. Plugins can be disabled in /Users/jbogie/.confluent/config.json.

Created connector "lcc-mv186q" (datagen_ccloud_pageviews).

Creating connector from connectors/ccloud-datagen-users.json

2022-10-24T12:08:04.759-0400 [DEBUG] Recursively searching $PATH for plugins. Plugins can be disabled in /Users/jbogie/.confluent/config.json.

Created connector "lcc-yo0mkp" (datagen_ccloud_users).
Waiting up to 300 seconds for connector connectors/ccloud-datagen-pageviews.json (datagen_ccloud_pageviews) to be RUNNING
......................................
Connector connectors/ccloud-datagen-pageviews.json (datagen_ccloud_pageviews) is RUNNING
Waiting up to 300 seconds for connector connectors/ccloud-datagen-users.json (datagen_ccloud_users) to be RUNNING

Connector connectors/ccloud-datagen-users.json (datagen_ccloud_users) is RUNNING

Sleeping 30 seconds to give the Datagen Source Connectors a chance to start producing messages

====== Setting up ksqlDB

⌛ Waiting up to 720 seconds for Confluent Cloud ksqlDB cluster to be UP
...........................................................
✔ Confluent Cloud KSQL is UP
Obtaining the ksqlDB App Id
✔ confluent ksql cluster list -o json | jq -r '.[].id'
	lksqlc-rrp561

Configuring ksqlDB ACLs
panic: runtime error: index out of range [0] with length 0

goroutine 1 [running]:
github.com/confluentinc/cli/internal/cmd/ksql.getCreateAclRequestDataList({0xc0000ec200, 0x26, 0xc0004c6480?})
	go/src/github.com/confluentinc/cli/internal/cmd/ksql/command_configureacls.go:184 +0x9d
github.com/confluentinc/cli/internal/cmd/ksql.(*ksqlCommand).configureACLs(0xc000472320, 0x20?, {0xc0008d26f0, 0x3, 0x3})
	go/src/github.com/confluentinc/cli/internal/cmd/ksql/command_configureacls.go:82 +0x3c8
github.com/confluentinc/cli/internal/pkg/cmd.Chain.func1(0xc000472e58?, {0xc0008d26f0, 0x3, 0x3})
	go/src/github.com/confluentinc/cli/internal/pkg/cmd/cobra.go:24 +0x7f
github.com/confluentinc/cli/internal/pkg/cmd.CatchErrors.func1(0xc000895900, {0xc0008d26f0, 0x3, 0x3})
	go/src/github.com/confluentinc/cli/internal/pkg/cmd/cobra.go:12 +0x69
github.com/spf13/cobra.(*Command).execute(0xc000895900, {0xc0008d26c0, 0x3, 0x3})
	go/1.19.0/pkg/mod/github.com/spf13/cobra@v1.5.0/command.go:872 +0x694
github.com/spf13/cobra.(*Command).ExecuteC(0xc000721680)
	go/1.19.0/pkg/mod/github.com/spf13/cobra@v1.5.0/command.go:990 +0x3bd
github.com/spf13/cobra.(*Command).Execute(...)
	go/1.19.0/pkg/mod/github.com/spf13/cobra@v1.5.0/command.go:918
github.com/confluentinc/cli/internal/cmd.Execute(0xc000721680, {0xc000136010?, 0x6691478?, 0x8?}, 0xc000256090)
	go/src/github.com/confluentinc/cli/internal/cmd/command.go:150 +0x1f7
main.main()
	go/src/github.com/confluentinc/cli/cmd/confluent/main.go:37 +0x28a
✘ error 2 occurred in start-cloud.sh at line 102
	confluent ksql cluster configure-acls lksqlc-rrp561 pageviews users
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@JakeBogie