Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Initial commit for distributed tests using crank #7323

Merged
merged 11 commits into from
Dec 14, 2021

Conversation

benjaminpetit
Copy link
Member

@benjaminpetit benjaminpetit commented Oct 4, 2021

null

Microsoft Reviewers: Open in CodeFlow

var counterGrain = client.GetGrain<ICounterGrain>(parameters.CounterKey);

var duration = await counterGrain.GetRunDuration();
BenchmarksEventSource.Register("duration", Operations.First, Operations.Last, "duration", "duration", "n0");
Copy link
Member

@ReubenBond ReubenBond Dec 7, 2021

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A comment or named parameter might help to make it clear what "n0" means

_logger.LogInformation($"{counter}: {value}");
BenchmarksEventSource.Register(counter, Operations.First, Operations.Sum, counter, counter, "n0");
BenchmarksEventSource.Measure(counter, value);
if (string.Compare(counter, "requests", StringComparison.InvariantCultureIgnoreCase) == 0)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

string.Equals seems to be the right choice instead, but it doesn't matter

<OutputType>Exe</OutputType>
<TargetFrameworks>$(TestTargetFrameworks)</TargetFrameworks>
<OrleansBuildTimeCodeGen>true</OrleansBuildTimeCodeGen>
<OutputPath Condition=" '$(DistributedOutputPath)'!='' ">$(DistributedOutputPath)/Distributed.Client</OutputPath>
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"DistributedTestsOutputPath" would be clearer

public async Task IssueRequest(int request)
{
var (router, targets) = _requestList[request % _requestList.Count];
await router.Ping(targets);
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For benchmarking purposes, it may make sense to not use 'await' and to elide these instead - but we can do that test optimization later


public CounterGrain(IOptions<ReportingOptions> options)
{
Debugger.Break();
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we should remove this Debugger.Break() - I recall that it can cause issues in some environments, but maybe I'm misremembering.

break;
}
}
while (_concurrencyGuard.CurrentCount != commonParameters.PipelineSize)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this technique will perform relatively poorly compared to what we have with ConcurrentLoadGenerator https://github.com/dotnet/orleans/blob/main/test/Benchmarks/Ping/ConcurrentLoadGenerator.cs

@@ -148,7 +148,7 @@ public void RecordDeliveryFailure()
/// <summary>
/// The limit of the maximum number of items that can be added
/// </summary>
public int GetMaxAddCount() { return 100; }
public int GetMaxAddCount() { return 200; }
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This seems unrelated to the rest

@ReubenBond ReubenBond merged commit 1ae2434 into dotnet:main Dec 14, 2021
benjaminpetit added a commit to benjaminpetit/orleans that referenced this pull request Dec 15, 2021
@benjaminpetit benjaminpetit deleted the distributed-tests branch March 30, 2022 13:00
@github-actions github-actions bot locked and limited conversation to collaborators Dec 2, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants