Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Workflow execution and scheduling latency #7370

Merged
merged 84 commits into from
Jan 30, 2024

Commits on Nov 6, 2023

  1. Defining Workflow metrics

    Signed-off-by: prateek041 <prateeksingh9741@gmail.com>
    prateek041 committed Nov 6, 2023
    Configuration menu
    Copy the full SHA
    2203b81 View commit details
    Browse the repository at this point in the history

Commits on Nov 10, 2023

  1. Added logic to record metrics for:

    - Operations
    - Reminders
    - Execution
    
    Signed-off-by: prateek041 <prateeksingh9741@gmail.com>
    prateek041 committed Nov 10, 2023
    Configuration menu
    Copy the full SHA
    fc670b3 View commit details
    Browse the repository at this point in the history
  2. Added logic to record workflowRemindersTotal metric

    Signed-off-by: prateek041 <prateeksingh9741@gmail.com>
    prateek041 committed Nov 10, 2023
    Configuration menu
    Copy the full SHA
    733bbfb View commit details
    Browse the repository at this point in the history

Commits on Nov 21, 2023

  1. Added logic to Record Workflow/operations metrics for:

    - Create Workflow
    - Get Workflow
    - Purge Workflow
    - Add Events
    
    Signed-off-by: prateek041 <prateeksingh9741@gmail.com>
    prateek041 committed Nov 21, 2023
    Configuration menu
    Copy the full SHA
    9519bb8 View commit details
    Browse the repository at this point in the history
  2. Add logic to record Failed workflow/operations metrics

    Signed-off-by: prateek041 <prateeksingh9741@gmail.com>
    prateek041 committed Nov 21, 2023
    Configuration menu
    Copy the full SHA
    4927cc4 View commit details
    Browse the repository at this point in the history
  3. Record metrics for Successful and Failed Wokflow/Activity

    executions.
    
    Signed-off-by: prateek041 <prateeksingh9741@gmail.com>
    prateek041 committed Nov 21, 2023
    Configuration menu
    Copy the full SHA
    a4025ed View commit details
    Browse the repository at this point in the history

Commits on Nov 26, 2023

  1. Merged failed/success metrics into one

    Signed-off-by: prateek041 <prateeksingh9741@gmail.com>
    prateek041 committed Nov 26, 2023
    Configuration menu
    Copy the full SHA
    9a3c080 View commit details
    Browse the repository at this point in the history
  2. Record Latency metrics for Operations and Executions

    Signed-off-by: prateek041 <prateeksingh9741@gmail.com>
    prateek041 committed Nov 26, 2023
    Configuration menu
    Copy the full SHA
    1322841 View commit details
    Browse the repository at this point in the history
  3. Questions regarding latency metrics

    Signed-off-by: prateek041 <prateeksingh9741@gmail.com>
    prateek041 committed Nov 26, 2023
    Configuration menu
    Copy the full SHA
    6b1bf39 View commit details
    Browse the repository at this point in the history

Commits on Dec 7, 2023

  1. Reducing functions to record metrics and code cleanup

    Signed-off-by: prateek041 <prateeksingh9741@gmail.com>
    prateek041 committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    624d435 View commit details
    Browse the repository at this point in the history

Commits on Dec 10, 2023

  1. Added Operation test

    Signed-off-by: prateek041 <prateeksingh9741@gmail.com>
    prateek041 committed Dec 10, 2023
    Configuration menu
    Copy the full SHA
    751d867 View commit details
    Browse the repository at this point in the history
  2. Added namespace and component key

    Signed-off-by: prateek041 <prateeksingh9741@gmail.com>
    prateek041 committed Dec 10, 2023
    Configuration menu
    Copy the full SHA
    d139476 View commit details
    Browse the repository at this point in the history
  3. Add tests for Reminders metrics

    Signed-off-by: prateek041 <prateeksingh9741@gmail.com>
    prateek041 committed Dec 10, 2023
    Configuration menu
    Copy the full SHA
    8dbee6e View commit details
    Browse the repository at this point in the history
  4. Added Execution metrics tests

    Signed-off-by: prateek041 <prateeksingh9741@gmail.com>
    prateek041 committed Dec 10, 2023
    Configuration menu
    Copy the full SHA
    7d35ed0 View commit details
    Browse the repository at this point in the history

Commits on Dec 11, 2023

  1. fix: fixed test conditions

    Signed-off-by: prateek041 <prateeksingh9741@gmail.com>
    prateek041 committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    dbacff4 View commit details
    Browse the repository at this point in the history

Commits on Dec 15, 2023

  1. cleanup

    Signed-off-by: prateek041 <prateeksingh9741@gmail.com>
    prateek041 committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    76a85da View commit details
    Browse the repository at this point in the history
  2. resolving conflicts

    Signed-off-by: prateek041 <prateeksingh9741@gmail.com>
    prateek041 committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    9881dd8 View commit details
    Browse the repository at this point in the history
  3. fix

    Signed-off-by: prateek041 <prateeksingh9741@gmail.com>
    prateek041 committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    374df01 View commit details
    Browse the repository at this point in the history

Commits on Dec 18, 2023

  1. fixing minor changes

    Signed-off-by: prateek041 <prateeksingh9741@gmail.com>
    prateek041 committed Dec 18, 2023
    Configuration menu
    Copy the full SHA
    5238fa0 View commit details
    Browse the repository at this point in the history

Commits on Dec 21, 2023

  1. minor fix

    Signed-off-by: prateek041 <prateeksingh9741@gmail.com>
    prateek041 committed Dec 21, 2023
    Configuration menu
    Copy the full SHA
    a6ed62b View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    4260b94 View commit details
    Browse the repository at this point in the history

Commits on Dec 23, 2023

  1. Fixing minor Nits

    Signed-off-by: prateek041 <prateeksingh9741@gmail.com>
    prateek041 committed Dec 23, 2023
    Configuration menu
    Copy the full SHA
    665b88e View commit details
    Browse the repository at this point in the history

Commits on Dec 25, 2023

  1. Added metrics to docs

    Signed-off-by: prateek041 <prateeksingh9741@gmail.com>
    prateek041 committed Dec 25, 2023
    Configuration menu
    Copy the full SHA
    55e4373 View commit details
    Browse the repository at this point in the history

Commits on Dec 26, 2023

  1. Added comments for metrics description

    Signed-off-by: prateek041 <prateeksingh9741@gmail.com>
    prateek041 committed Dec 26, 2023
    Configuration menu
    Copy the full SHA
    612af02 View commit details
    Browse the repository at this point in the history
  2. Removed reminders count metrics

    Signed-off-by: prateek041 <prateeksingh9741@gmail.com>
    prateek041 committed Dec 26, 2023
    Configuration menu
    Copy the full SHA
    4a2581a View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    3ccbbe1 View commit details
    Browse the repository at this point in the history

Commits on Dec 27, 2023

  1. empty commit

    Signed-off-by: Shivam Kumar <shivamkm07@gmail.com>
    shivamkm07 committed Dec 27, 2023
    Configuration menu
    Copy the full SHA
    f00c5cd View commit details
    Browse the repository at this point in the history
  2. fixes

    Signed-off-by: Shivam Kumar <shivamkm07@gmail.com>
    shivamkm07 committed Dec 27, 2023
    Configuration menu
    Copy the full SHA
    4c1d076 View commit details
    Browse the repository at this point in the history

Commits on Dec 28, 2023

  1. Rename workflow_metrics.go -> workflow_monitoring.go

    Signed-off-by: Shivam Kumar <shivamkm07@gmail.com>
    shivamkm07 committed Dec 28, 2023
    Configuration menu
    Copy the full SHA
    eb920b8 View commit details
    Browse the repository at this point in the history
  2. Updating dapr-metrics docs

    Signed-off-by: Shivam Kumar <shivamkm07@gmail.com>
    shivamkm07 committed Dec 28, 2023
    Configuration menu
    Copy the full SHA
    4ee9224 View commit details
    Browse the repository at this point in the history
  3. typo

    Signed-off-by: Shivam Kumar <shivamkm07@gmail.com>
    shivamkm07 committed Dec 28, 2023
    Configuration menu
    Copy the full SHA
    0e899e2 View commit details
    Browse the repository at this point in the history
  4. Adding comment

    Signed-off-by: Shivam Kumar <shivamkm07@gmail.com>
    shivamkm07 committed Dec 28, 2023
    Configuration menu
    Copy the full SHA
    b9b7ebc View commit details
    Browse the repository at this point in the history
  5. Avoid collecting metrics in case workflow is already completed before…

    … execution
    
    Signed-off-by: Shivam Kumar <shivamkm07@gmail.com>
    shivamkm07 committed Dec 28, 2023
    Configuration menu
    Copy the full SHA
    bc847c9 View commit details
    Browse the repository at this point in the history

Commits on Jan 2, 2024

  1. linter fixes

    Signed-off-by: Shivam Kumar <shivamkm07@gmail.com>
    shivamkm07 committed Jan 2, 2024
    Configuration menu
    Copy the full SHA
    d61f24e View commit details
    Browse the repository at this point in the history

Commits on Jan 3, 2024

  1. Configuration menu
    Copy the full SHA
    39d4ef8 View commit details
    Browse the repository at this point in the history

Commits on Jan 5, 2024

  1. Update pkg/diagnostics/workflow_monitoring.go

    Co-authored-by: Mukundan Sundararajan <65565396+mukundansundar@users.noreply.github.com>
    Signed-off-by: Shivam Kumar <shivamkm07@gmail.com>
    shivamkm07 and mukundansundar committed Jan 5, 2024
    Configuration menu
    Copy the full SHA
    666f1bf View commit details
    Browse the repository at this point in the history

Commits on Jan 8, 2024

  1. Configuration menu
    Copy the full SHA
    6126529 View commit details
    Browse the repository at this point in the history
  2. Adding activity execution metrics as separate metrics

    Signed-off-by: Shivam Kumar <shivamkm07@gmail.com>
    shivamkm07 committed Jan 8, 2024
    Configuration menu
    Copy the full SHA
    29747f8 View commit details
    Browse the repository at this point in the history
  3. renaming componentName

    Signed-off-by: Shivam Kumar <shivamkm07@gmail.com>
    shivamkm07 committed Jan 8, 2024
    Configuration menu
    Copy the full SHA
    da4cb40 View commit details
    Browse the repository at this point in the history
  4. adding workflow latency execution

    Signed-off-by: MD Ashique <noorani.ashique5@gmail.com>
    ASHIQUEMD committed Jan 8, 2024
    Configuration menu
    Copy the full SHA
    ed05c27 View commit details
    Browse the repository at this point in the history

Commits on Jan 9, 2024

  1. Adding IT for metrics wf

    Signed-off-by: Shivam Kumar <shivamkm07@gmail.com>
    shivamkm07 committed Jan 9, 2024
    Configuration menu
    Copy the full SHA
    4cbccba View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    ec1b5fb View commit details
    Browse the repository at this point in the history
  3. linter fixes

    Signed-off-by: Shivam Kumar <shivamkm07@gmail.com>
    shivamkm07 committed Jan 9, 2024
    Configuration menu
    Copy the full SHA
    508978f View commit details
    Browse the repository at this point in the history

Commits on Jan 10, 2024

  1. Configuration menu
    Copy the full SHA
    2c7355b View commit details
    Browse the repository at this point in the history

Commits on Jan 11, 2024

  1. Configuration menu
    Copy the full SHA
    56d0808 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    0907987 View commit details
    Browse the repository at this point in the history
  3. Updating docs

    Signed-off-by: Shivam Kumar <shivamkm07@gmail.com>
    shivamkm07 committed Jan 11, 2024
    Configuration menu
    Copy the full SHA
    55ec256 View commit details
    Browse the repository at this point in the history
  4. Removing componentKey from wf metrics

    Signed-off-by: Shivam Kumar <shivamkm07@gmail.com>
    shivamkm07 committed Jan 11, 2024
    Configuration menu
    Copy the full SHA
    32aab9d View commit details
    Browse the repository at this point in the history
  5. Merge latest changes of PR7152

    Signed-off-by: MD Ashique <noorani.ashique5@gmail.com>
    ASHIQUEMD committed Jan 11, 2024
    Configuration menu
    Copy the full SHA
    10074e3 View commit details
    Browse the repository at this point in the history
  6. time calculation

    Signed-off-by: MD Ashique <noorani.ashique5@gmail.com>
    ASHIQUEMD committed Jan 11, 2024
    Configuration menu
    Copy the full SHA
    bd03e78 View commit details
    Browse the repository at this point in the history
  7. Add schedule latency and execution latency of workflow

    Signed-off-by: MD Ashique <noorani.ashique5@gmail.com>
    ASHIQUEMD committed Jan 11, 2024
    Configuration menu
    Copy the full SHA
    f02c2b2 View commit details
    Browse the repository at this point in the history
  8. Add schedule latency and execution latency of workflow

    Signed-off-by: MD Ashique <noorani.ashique5@gmail.com>
    ASHIQUEMD committed Jan 11, 2024
    Configuration menu
    Copy the full SHA
    fa8476d View commit details
    Browse the repository at this point in the history

Commits on Jan 12, 2024

  1. Add schedule latency and execution latency of workflow

    Signed-off-by: MD Ashique <noorani.ashique5@gmail.com>
    ASHIQUEMD committed Jan 12, 2024
    Configuration menu
    Copy the full SHA
    87759c6 View commit details
    Browse the repository at this point in the history
  2. Add schedule latency and execution latency of workflow

    Signed-off-by: MD Ashique <noorani.ashique5@gmail.com>
    ASHIQUEMD committed Jan 12, 2024
    Configuration menu
    Copy the full SHA
    7be24f9 View commit details
    Browse the repository at this point in the history
  3. update latency code

    Signed-off-by: MD Ashique <noorani.ashique5@gmail.com>
    ASHIQUEMD committed Jan 12, 2024
    Configuration menu
    Copy the full SHA
    6a34086 View commit details
    Browse the repository at this point in the history
  4. update latency code

    Signed-off-by: MD Ashique <noorani.ashique5@gmail.com>
    ASHIQUEMD committed Jan 12, 2024
    Configuration menu
    Copy the full SHA
    f702699 View commit details
    Browse the repository at this point in the history
  5. update latency code

    Signed-off-by: MD Ashique <noorani.ashique5@gmail.com>
    ASHIQUEMD committed Jan 12, 2024
    Configuration menu
    Copy the full SHA
    866b757 View commit details
    Browse the repository at this point in the history

Commits on Jan 15, 2024

  1. Configuration menu
    Copy the full SHA
    f9cf2ef View commit details
    Browse the repository at this point in the history
  2. Fix unit tests

    Signed-off-by: MD Ashique <noorani.ashique5@gmail.com>
    ASHIQUEMD committed Jan 15, 2024
    Configuration menu
    Copy the full SHA
    f5db2e3 View commit details
    Browse the repository at this point in the history
  3. add code comment

    Signed-off-by: MD Ashique <noorani.ashique5@gmail.com>
    ASHIQUEMD committed Jan 15, 2024
    Configuration menu
    Copy the full SHA
    6f8c058 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    5bed4b5 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    e8e4323 View commit details
    Browse the repository at this point in the history

Commits on Jan 16, 2024

  1. Removing status from scheduling latency

    Signed-off-by: MD Ashique <noorani.ashique5@gmail.com>
    ASHIQUEMD committed Jan 16, 2024
    Configuration menu
    Copy the full SHA
    4d27037 View commit details
    Browse the repository at this point in the history
  2. Merge branch 'workflow-metrics' of https://github.com/ASHIQUEMD/dapr

    …into workflow-metrics
    ASHIQUEMD committed Jan 16, 2024
    Configuration menu
    Copy the full SHA
    41c4586 View commit details
    Browse the repository at this point in the history

Commits on Jan 17, 2024

  1. save start workflowtime to metdata

    Signed-off-by: MD Ashique <noorani.ashique5@gmail.com>
    ASHIQUEMD committed Jan 17, 2024
    Configuration menu
    Copy the full SHA
    68b2dfa View commit details
    Browse the repository at this point in the history
  2. save start workflowtime to metdata

    Signed-off-by: MD Ashique <noorani.ashique5@gmail.com>
    ASHIQUEMD committed Jan 17, 2024
    Configuration menu
    Copy the full SHA
    b64a6fa View commit details
    Browse the repository at this point in the history
  3. save start workflowtime to metdata

    Signed-off-by: MD Ashique <noorani.ashique5@gmail.com>
    ASHIQUEMD committed Jan 17, 2024
    Configuration menu
    Copy the full SHA
    8ad0237 View commit details
    Browse the repository at this point in the history
  4. refactor wfstarttime capture by reading it from history

    Signed-off-by: MD Ashique <noorani.ashique5@gmail.com>
    ASHIQUEMD committed Jan 17, 2024
    Configuration menu
    Copy the full SHA
    9378f9d View commit details
    Browse the repository at this point in the history
  5. Update pkg/diagnostics/workflow_monitoring.go

    Co-authored-by: Alessandro (Ale) Segala <43508+ItalyPaleAle@users.noreply.github.com>
    Signed-off-by: MD Ashique <noorani.ashique5@gmail.com>
    ASHIQUEMD and ItalyPaleAle committed Jan 17, 2024
    Configuration menu
    Copy the full SHA
    b531abe View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    4160325 View commit details
    Browse the repository at this point in the history
  7. Adding executionStartedTimestamp property to ExecutionStartedEvent me…

    …ssage
    
    Signed-off-by: MD Ashique <noorani.ashique5@gmail.com>
    ASHIQUEMD committed Jan 17, 2024
    Configuration menu
    Copy the full SHA
    a733773 View commit details
    Browse the repository at this point in the history

Commits on Jan 18, 2024

  1. Adding executionStartedTimestamp property to ExecutionStartedEvent me…

    …ssage
    
    Signed-off-by: MD Ashique <noorani.ashique5@gmail.com>
    ASHIQUEMD committed Jan 18, 2024
    Configuration menu
    Copy the full SHA
    baef5f4 View commit details
    Browse the repository at this point in the history
  2. Adding executionStartedTimestamp property to ExecutionStartedEvent me…

    …ssage
    
    Signed-off-by: MD Ashique <noorani.ashique5@gmail.com>
    ASHIQUEMD committed Jan 18, 2024
    Configuration menu
    Copy the full SHA
    b500b0e View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    ef7b35c View commit details
    Browse the repository at this point in the history

Commits on Jan 19, 2024

  1. Merge branch 'master' into workflow-metrics

    Signed-off-by: MD Ashique <noorani.ashique5@gmail.com>
    ASHIQUEMD committed Jan 19, 2024
    Configuration menu
    Copy the full SHA
    eaa01d6 View commit details
    Browse the repository at this point in the history
  2. Adding executionStartedTimestamp property to ExecutionStartedEvent me…

    …ssage
    
    Signed-off-by: MD Ashique <noorani.ashique5@gmail.com>
    ASHIQUEMD committed Jan 19, 2024
    Configuration menu
    Copy the full SHA
    f6419bd View commit details
    Browse the repository at this point in the history

Commits on Jan 25, 2024

  1. Configuration menu
    Copy the full SHA
    c9a2029 View commit details
    Browse the repository at this point in the history
  2. Calculate dapr workflow latency

    Signed-off-by: MD Ashique <noorani.ashique5@gmail.com>
    ASHIQUEMD committed Jan 25, 2024
    Configuration menu
    Copy the full SHA
    98d8190 View commit details
    Browse the repository at this point in the history
  3. Calculate dapr workflow latency

    Signed-off-by: MD Ashique <noorani.ashique5@gmail.com>
    ASHIQUEMD committed Jan 25, 2024
    Configuration menu
    Copy the full SHA
    bf5b8f8 View commit details
    Browse the repository at this point in the history

Commits on Jan 29, 2024

  1. Configuration menu
    Copy the full SHA
    12da6a5 View commit details
    Browse the repository at this point in the history
  2. Add integration test for workflow execution and scheduling latency

    Signed-off-by: MD Ashique <noorani.ashique5@gmail.com>
    ASHIQUEMD committed Jan 29, 2024
    Configuration menu
    Copy the full SHA
    ac1ba7b View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    d4aa986 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    f3871bf View commit details
    Browse the repository at this point in the history

Commits on Jan 30, 2024

  1. Configuration menu
    Copy the full SHA
    17d83ff View commit details
    Browse the repository at this point in the history