6.7.0

Fix Issue #143 - more grid-bundle decoupling.

6.6.0

Fix Issue #145
Fix php 8.0 testing compatibility
Fix stats issue with beanstalkd
Fix travis build, remove builds for 7.2, 7.1

6.5.0

Address Issue #140 by differentiating ORM vs others.

6.4.0

Address Issue #136 - change controller specification in routing.yml

6.3.6

Address Issue #138 - allow specification of a LoggerService from RunCommand again.

6.3.5

Fix unit test.

6.3.4

Issue #134 - change suggested version of DtcGridBundle again.

6.3.3

Issue #134 - change suggested version of DtcGridBundle.

6.3.2

Issue #137 - Fix snc_redis alias.

6.3.1

Issue #134 - Address more Doctrine changes.

6.3.0

Issue #134 - seems that Doctrine removed the deprecated Doctrine\Common\Persistence\ObjectManager in favor of Doctrine\Persistence\Objectmanager in doctrine/orm#7953.

6.2.1

Patch deprecation fix for 5.1.

6.2.0

Deprecation fix for 5.1.
Fix build, update mongo getJob a bit.

6.1.1

Fix issue #129 with pheanstalk.

6.1.0

Fix issue #129 with pheanstalk.

6.0.10

Fix doctrine in WorkerCompilerPass.

6.0.9

Fix typo, documentation.

6.0.8

Change grid-bundle version in suggest.

6.0.7

Issue #113 - bump mmucklo/grid-bundle >=6 and make dependency fully optional.
Permit Symfony 5.

6.0.6

Issue #126 - fix setting of timezone.

6.0.5

Restrict mmucklo/grid-bundle to < 6

6.0.4

Fix layout.html.twig issue

6.0.3

Fix deprecation warnings.
Issue #123 - Doctrine ODM 2 support
Issue #123 - Symfony 4.4 compatibility fix.

6.0.2

Issue #113 - attempt to address a long tail issue with annotations

6.0.1

Issue #117 - disable DtcGridBundle compiler pass dependency

6.0.0

Issue #115 - remove suppot for 5.6 and 7.0
Issue #113 - make DtcGridBundle (mmucklo/grid-bundle) optional.

5.1.1

A workaround for #98, must set locale_fix: true in dtc_queue.yaml configuration.

5.1.0

Issue #98 fix microtime issues in locales that do not use '.' for the decimal point.
Fix logging issue when there's an exception caught in a run.

5.0.1

Pulling in a Query Builder fix from a fork https://github.com/quitoque/QueueBundle/commit/00f788e84765df2dcb81a19907463dd8eace566d

5.0.0

PR #111 (@therealartz) - Fixes TreeBuilder deprecation notice on Symfony 4.2
Issue #89 convert UI to bootstrap 4

4.10.1

Issue #88 more fixes for postgres

4.10.0

Issue #88 require new version of grid-bundle for Postgres fix

4.9.1

Issue #87 revisited - be explicit on all column names, just in case.

4.9.0

Issue #87 - hard-wire multi-word column names so that indexes work even when the underscore naming strategy isn't specified.

4.8.1

PR #86 - call setName in the create_job command.

4.8.0

Issue #82 - Allow for cli enqueuing of jobs with non-string arguments - see /Resources/doc/create-job.md

4.7.1

Fix for issue #79 - Subclassing issue

4.7.0

Fix for issue #74 - allow infinite durations
Address issue #77 in the README

4.6.1

Fix for issue #75 - fix redis auth

4.6.0

Fix for issue #72 - pruneErroneousJobs -> pruneExceptionJobs
Fix for issue #73 - prune job_timings fix

4.5.3

Fix for issue #68 - attempt to remove dependency on doctrine service when orm is not used
Fix for issue #67 - make DateTime calls consistent

4.5.2

Fix for issue #63 (thanks @andrzej-tracz for PR #64)

4.5.1

Fix a minor bug in ORM where if you created a job you later tried to then run in the same process the status might not be reflected properly in the object
Refactored the EntityManager reset and related detection logic so that ODM doesn't pass through it (let me know if there's any issues there).
Fix issues with Redis when there's no priority being set.
Added a test for Redis without Priority.

4.5.0

Fix serious bug in ORM where multiple workers could have taken the same job twice

4.4.1

Fix typo issue per PR #54

4.4.0

Attempt to fix issue where ORM EntityManager closes by trying to reopen it

4.3.2

Attempt to fix a bug when a job gets archived multiple times

4.3.1

Issue #36 - yet another fix

4.3.0

Issue #42 - better statistics for Redis status

4.2.0

Fix MongoDB operations when there's no collection(s) yet present (issue #39)

4.1.0

Enable bin/console dtc:queue:count counts on Redis / RabbitMq / Beanstalkd.
Add a Prune Stalled button on Running jobs page.

4.0.3

Another fix around issue #36

4.0.2

Fix issue #36 (a bug with the count command)

4.0.1

A bunch of definitions were set wrong for 4.0.0 and some how escaped testing

4.0.0

Redis support
Auto Retry
- Jobs that fail will automatically be retried a certain number of times, by being re-enqueued
- Tunable Defaults
  - The number of max retries is tunable
  - The number of max exceptions, failures is tunable
  - The number of permitted stalls is also tunable
  - Exceptions can be auto-retried, but by default are not.
Worker class changes
- Access signatures change
  - $jobManager made private in Worker base class. Still accessible through getJobManager()
- Access to Current Job (inspired by the fork of @wzele)
  - $this->getCurrentJob() will return the current Job object during a worker's method invocation.
    - This may be useful if you want to record some message by calling $this->getCurrentJob()->setMessage('some message');
    - However only Doctrine Jobs are persisted on SUCCESS
- $jobClass removed
  - $jobClass member variable, and getJobClass() / setJobClass() functions removed (now loaded from JobManager).
- $jobManager made private - use getter/setter to access it.
Class Moves
- All Manager classes and interfaces into their own Manager directory
New STATUS_FAILURE
- If you return \Dtc\QueueBundle\Model\Worker::RESULT_FAILURE from your Worker's function, it will be recorded as a failure, not an error
BaseJob::STATUS_ERROR => BaseJob::STATUS_EXCEPTION
- Exceptions are now recorded as such.
- Exception information is recorded in the end of the message of the
Changed STATUS_ERROR to STATUS_EXCEPTION
Refactoring
- JobManager base class heirarchy has been refactored.
  - Supports retryable jobs in all JobManager types
- Job base class heirarchy refactored
  - There's now a DoctrineJob which alone contains the Lock/unlock fields as it's only relevant to that Job type
ODM/ORM changes
- stalledCount / stalled_count renamed to stalls
- errorCount / error_count renamed to exceptions
- max_errors renamed to max_exceptions
- max_stalled renamed to max_stalls
- removed locked and locked_at (redundant)
Bug fix - add Compiler passes for RabbitMq, and Beanstalk
Support for Microseconds in ORM, ODM
Timezone fix for ORM
- Will now store a microtime representation in a Decimal column called whenUs
Fix a bug where $runId was not being set when ORM was "taking" a job.

3.1.3

Fix a bug with runIds not being passed in properly

3.1.2

Fix a bug in timings by minute for ORM
Fix a bug in ODM timings
Add more tests

3.1.1

Fix a bug in LiveJobsGridSource for ORM
Refactored out some Archive logic into ArchivableJobManager
Added more tests

3.1.0

Rename Live Jobs to Waiting Jobs, and add Running Jobs tab
New Archive button on the Waiting Jobs administration page to archive all jobs at once
Fix a bug when running doctrine orm and odm simulatenously

3.0.4

Refactoring out the TrendsController from the QueueController, ran php-cs-fixer

3.0.2

Updates to trends page, GridBundle version, WorkerCompilerTest

3.0.1

Bump DtcGridBundle requirement

3.0.0

Symfony 4 support
Enabled Garbage collection during usage of RunCommand, but allow it to be disabled via a command-line option --disable-gc
Changed some command-line parameters to have "-" instead of "_" (see UPGRADING-3.0.md)
Added a "status" column to JobTiming, plus updated the index for ORM
Updated the trends graph to show multiple statuses

2.7.13

fixed wrong template

2.7.12

fix templating issue by being explicit

2.7.11

back out object manager setting to make SensioLabs Insight happier..

2.7.10

Make services public for now

2.7.9

Add a method to set the object manager for RunManager and JobManager

2.7.8

Fix ODM (mongo) status function

2.7.7

Updates to the trends page

2.7.6

Fix bug with LiveJob Query

2.7.5

Fix bug with Job count query

2.7.4

Fix the dependency issue pt.2

2.7.3

Fix the dependency issue

2.7.2

Attempt to fix a dependency issue

2.7.1

Fix a bug in mongo Job Manager
Travis build fixes for RunManager
Travis build for 7.2

2.7.0

Administrative updates
- Add a header to admin pages
- Show Live Jobs for ODM and ORM according to actual jobs query (won't show expired jobs)
- Separate page for showing "All" Jobs + "Archived" Jobs
- Added Workers list page
- Added Trends page
Fixed a bug where run_manager being different than default_manager could cause a problem

2.6.7

Remove transactions from ORM to avoid lock contention issues
Add more testing

2.6.6

Another bug with PHP >= 7

2.6.5

2nd bug with runId in ORM

2.6.4

bug with runId in ORM

2.6.3

Remove transactions from getJob() to avoid locking contention

2.6.2

Prevent infinite looping if commits keep failing

2.6.1

Fix a bug in ORM\JobManager

2.6.0

Fix a race-condition with batching in ORM and ODM
Fix a bug with prioritization not being done right with ORM and ODM
Add more testing, fix extended configuration for RabbitMQ, and make it work properly
Fixes from SensioLabs Insights
May have been an issue with instantiating a rabbit_mq / beanstalkd based queue
Schema Update:
- Added a new column to Run: currentJobId
  - tracks the id of the currently running job (null if nothing)

2.5.3

Fix a bug in queue.yml

2.5.2

Add a test
Fix a few issues from Sensio Insight
PR#21 - Support sensio/framework-extra-bundle:5.*

2.5.1

Fix PruneCommand output in certain cases

2.5.0

Fix bug with archiving of Runs
Add a prune for stalled runs

2.4.0

Fix bug with bad annotation
Fix priorities - now there's a max priority and priority direction setting in configuration
Added tests for Priorities for ODM / ORM, plus RabbitMQ

2.3.3

Fix build

2.3.2

Add initial testing for WorkerCompilerPass

2.3.1

Fix bug with JobTiming class

2.3.0

Added a new JobTiming entity/document to separately track timing information for each run
Fix a bug in beanstalkd and rabbitmq JobManager classes where expired jobs could cause a loop
Added more unit tests
Fixed a few bugs with rabbitmq configuration options that weren't able to be passed through

2.2.0

Create a RunManager for tracking Runs
Add a new config parameter run_manager so that a job queue can have a separate store-type for Runs
Unit test commands
Added ability to prune old Run entries
Refactoring of RunCommand and other areas to hopefully improve or at least maintain code quality
Updated README
Fixed issue #15 - should make things work again on Symfony 2

2.1.1

Upped GridBundle requirement
Refactoring and tests
Updated getStatus method in BaseJobManager's present derived classes with new statuses

2.1.0

Fix bug in pruning of stalled jobs
Refactoring of updatedAt and createdAt out of Model\Job
Created a new subclass called RetryableJob
- Add a max retries
- Add a max stalled
- Add a max error
Fixed unit tests for ORM
Made job methods chainable

2.0.1

Update precision for expiresAt for beanstalkd and RabbitMQ
Fixed a bug with batchLater($delay) - where $delay was interpreted as a unixtimestamp, instead of the seconds to delay

2.0.0

Rename of core commands
- Old: dtc:queue_worker:*
- New: dtc:queue:*
RunCommand (dtc:queue:run):
- Refined options:
  - -d [--duration - exit after time elapses beyond this many seconds]
  - -m [--max_count - maximum number of jobs to process before existing]
    - This was formerly --total_jobs / -t
  - -l [--logger service name e.g. monolog.logger.dtc_queue]
  - -s [--nano_sleep (nanoseconds) to sleep when there's no jobs in the queue]
  - -t [--timeout (in seconds) for the process]
  - -i [--id of job to run]
- Removed redundant options
  - --total_jobs / -t -> replaced by --max_count / -m
  - --id -> --id / -i
  - --job_id -> removed in favor of --id / -i
PruneCommand (dtc:queue:prune):
- Now takes an argument:
  - error|expired|old
    - error: prunes errored jobs (from archive queue)
    - expired: prunes expired jobs (from live queue)
    - old: prunes archived jobs older than:
      - --older (\d+)([d|m|y|h|i|s]){0,1}
      - e.g. --older 1m
      - --older 1y
      - e.g. --older 36h
      - e.g. --older 86400s
ResetJ
New: logs each run into a specified datastore
New: ORM-based storage
New: Job archive table (for completed and/or errored jobs)
Config change: renamed mongo Documents to Document - you may need to update config.yml in the mongodb section:

Before

doctrine_mongodb:
    connections:
        default:
            server: "%mongodb_server%"
            options: {}
    default_database: symfony
    document_managers:
        default:
            auto_mapping: true
            mappings:
                DtcQueueBundle:
                    dir: Documents/
                    type: annotation

After

doctrine_mongodb:
    connections:
        default:
            server: "%mongodb_server%"
            options: {}
    default_database: symfony
    document_managers:
        default:
            auto_mapping: true
            mappings:
                DtcQueueBundle:
                    dir: Document/
                    type: annotation

changed mongo database from queue to dtc_queue
renamed when to whenAt
renamed expires to expiresAt
Added new ORM JobManager
For MongoDB and ORM jobs, when the job is retrieved, change status to 'running'.
- Fixes a race condition where jobs could be added in batch mode that weren't getting processed due to a stuck 'locked' job that was still in status 'new'
Changed routing
- New routing.yml file to reference
- New standard routing prefix "/dtc_queue/" Before:

queue:
    resource: "@DtcQueueBundle/Controller/QueueController.php"
    prefix:  /queue/
    type: annotation

After:

queue:
    resource: '@DtcQueueBundle/Resources/config/routing.yml'

Files

CHANGELOG.md

Latest commit

History

CHANGELOG.md

File metadata and controls

6.7.0

6.6.0

6.5.0

6.4.0

6.3.6

6.3.5

6.3.4

6.3.3

6.3.2

6.3.1

6.3.0

6.2.1

6.2.0

6.1.1

6.1.0

6.0.10

6.0.9

6.0.8

6.0.7

6.0.6

6.0.5

6.0.4

6.0.3

6.0.2

6.0.1

6.0.0

5.1.1

5.1.0

5.0.1

5.0.0

4.10.1

4.10.0

4.9.1

4.9.0

4.8.1

4.8.0

4.7.1

4.7.0

4.6.1

4.6.0

4.5.3

4.5.2

4.5.1

4.5.0

4.4.1

4.4.0

4.3.2

4.3.1

4.3.0

4.2.0

4.1.0

4.0.3

4.0.2

4.0.1

4.0.0

3.1.3

3.1.2

3.1.1

3.1.0

3.0.4

3.0.2

3.0.1

3.0.0

2.7.13

2.7.12

2.7.11

2.7.10

2.7.9

2.7.8

2.7.7

2.7.6

2.7.5

2.7.4

2.7.3