Skip to content

Latest commit

 

History

History
695 lines (539 loc) · 63.6 KB

CHANGELOG.md

File metadata and controls

695 lines (539 loc) · 63.6 KB
Raw

Changelog

v0.6.2 (2020-08-02)

Full Changelog

Implemented enhancements:

  • Redis sink flushes only rows that have more recent eventTimestamp #913 (pyalex)
  • Dataflow runner options: disk type & streaming engine #906 (pyalex)
  • Add Structured Audit Logging #891 (mrzzy)
  • Add Authentication and Authorization for feast serving #865 (jmelinav)
  • Throw more informative exception when write_triggering_frequency_seconds is missing #917 (pyalex)
  • Add caching to authorization #884 (jmelinav)
  • Add Auth header #885 (AnujaVane)

Fixed bugs:

  • Fix Online Serving unable to retrieve feature data after Feature Set update. #908 (mrzzy)
  • Fix Python SDK ingestion for featureset name that exist in multiple projects #868 (terryyylim)
  • Backport delay in Redis acknowledgement of spec #915 (woop)
  • Allow unauthenticated access when Authorization is disabled and to Health Probe #927 (mrzzy)

Merged pull requests:

v0.6.1 (2020-07-17)

Full Changelog

Implemented enhancements:

  • Improve parallelization in Redis Sink #866 (pyalex)
  • BQ sink produces sample of successful inserts #875 (pyalex)

Fixed bugs:

  • Add IngestionId & EventTimestamp to FeatureRowBatch to calculate lag metric correctly #874 (pyalex)
  • Prevent race condition in BQ sink jobId generation #877 (pyalex)

v0.6.0 (2020-07-13)

Full Changelog

Breaking changes:

  • Compute and write metrics for rows prior to store writes #763 (zhilingc)

Implemented enhancements:

  • Allow users compute statistics over retrieved batch datasets #799 (zhilingc)
  • Replace Keto Authorization with External HTTP Authorization #864 (woop)
  • Add disk size as Dataflow Job Configuration #841 (khorshuheng)
  • JobCoordinator may be turned off by configuration #829 (pyalex)
  • Allow ingestion job grouping/consolidation to be configurable #825 (pyalex)
  • Add subscriptions blacklist functionality #813 (terryyylim)
  • Add Common module #801 (terryyylim)
  • FeatureSets are delivered to Ingestion Job through Kafka #792 (pyalex)
  • Add YAML export to Python SDK #782 (woop)
  • Add support to Python SDK for staging files on Amazon S3 #769 (jmelinav)
  • Add support for version method in Feast SDK and Core #759 (woop)
  • Upgrade ingestion to allow for in-flight updates to feature sets for sinks #757 (pyalex)
  • Add Discovery API for listing features #797 (terryyylim)
  • Authentication and authorization support #793 (dr3s)
  • Add API for listing feature sets using labels #785 (terryyylim)

Fixed bugs:

  • Bypass authentication for metric endpoints #862 (woop)
  • Python SDK listing of ingestion job fails for featureset reference filter #861 (terryyylim)
  • Fix BigQuerySink successful output to produce only once #858 (pyalex)
  • Re-applying of featuresets does not update label changes #857 (terryyylim)
  • BQ Sink is failing when Feature consists of only null values #853 (pyalex)
  • Fix FeatureSetJobStatus removal #848 (pyalex)
  • Fix: JobCoordinator tries to create duplicate FeatureSetJobStatuses #847 (pyalex)
  • Replace IngestionJob when store was updated #846 (pyalex)
  • Don't send unrecognized featureSets to deadletter in IngestionJob #845 (pyalex)
  • Deallocate featureSet from job when source changed #844 (pyalex)
  • Fix CPU count selection in Python SDK for non-Unix #839 (pyalex)
  • Write metrics for store allocated rows only #830 (zhilingc)
  • Prevent reserved fields from being registered #819 (terryyylim)
  • Fix Optional#get() and string comparison bugs in JobService #804 (ches)
  • Publish helm chart script should not modify the chart content #779 (khorshuheng)
  • Fix pipeline options toArgs() returning empty list #765 (zhilingc)
  • Remove usage of parallel stream for feature value map generation #751 (khorshuheng)

Merged pull requests:

  • Remove Spring Boot from auth tests #859 (woop)
  • Authentication and Authorization into feast-auth module. #856 (jmelinav)
  • Keep StoreProto inside JobStore to decouple JobCoordination from SpecService internals #852 (pyalex)
  • Enable isort for Python SDK #843 (woop)
  • Replace batch with historical for Python SDK retrieval #842 (woop)
  • Upgrade pandas to 1.0.x #840 (duongnt)
  • Ensure store subscriptions are migrated to allow exclusion schema #838 (pyalex)
  • Remove project reference from feature set id in stats example notebook #836 (zhilingc)
  • Enable linting and formatting for e2e tests #832 (woop)
  • IngestionJob is being gracefully replaced to minimize downtime #828 (pyalex)
  • Add native types for Python SDK online retrieval #826 (terryyylim)
  • Send acknowledgment on Spec Update only after sinks are ready #822 (pyalex)
  • Remove Duplicated Strip Projects Code from SDKs #820 (mrzzy)
  • Consolidate ingestion jobs to one job per source #817 (pyalex)
  • Add missing key count metric #816 (terryyylim)
  • Create table in BigQuery if doesn't exists when new FeatureSetSpec arrived to IngestionJob #815 (pyalex)
  • Refactor common module's feature string reference method #814 (terryyylim)
  • Fix typo in documentation #811 (ravisuhag)
  • Database Schema migration for RELEASE 0.6 with Flyway #810 (pyalex)
  • Update helm installation docs - Fix broken link #808 (davidheryanto)
  • Add authentication support for end-to-end tests #807 (jmelinav)
  • Use latest instead of dev as the default image tag in helm charts #806 (duongnt)
  • Build Feast Jupyter image and clean up examples #803 (woop)
  • Move communication with IngestionJob to JobCoordinator #800 (pyalex)
  • Compression of FeatureRows collection in memory #798 (pyalex)
  • Add Kubernetes Pod labels to Core and Serving. #795 (ashwinath)
  • Add v0.3.8 changelog #788 (ches)
  • Update change log due to release 0.5.1 #783 (khorshuheng)
  • Refactor end-to-end tests to reduce duplication #758 (woop)
  • Recompile golang protos to include new FeatureSetStatus #755 (zhilingc)
  • Merge Redis cluster connector with Redis connector #752 (pyalex)

0.5.1 (2020-06-06)

Full Changelog

Implemented enhancements:

  • Add support for version method in Feast SDK and Core #759 (woop)
  • Refactor runner configuration, add labels to dataflow options #718 (zhilingc)

Fixed bugs:

  • Fix pipeline options toArgs() returning empty list #765 (zhilingc)
  • Fix project argument for feature set describe in CLI #731 (terryyylim)
  • Fix Go and Java SDK Regressions #729 (mrzzy)
  • Remove usage of parallel stream for feature value map generation #751 (khorshuheng)
  • Restore Feast Java SDK and Ingestion compatibility with Java 8 runtimes #722 (ches)
  • Python sdk bug fixes #723 (zhilingc)

Merged pull requests:

  • Increase Jaeger Tracing coverage #719 (terryyylim)
  • Recompile golang protos to include new FeatureSetStatus #755 (zhilingc)
  • Merge Redis cluster connector with Redis connector #752 (pyalex)
  • Remove unused Hibernate dep from Serving #721 (ches)

v0.5.0 (2020-05-19)

Full Changelog

Breaking changes:

  • Add .proto to packages of Protobuf generated Java classes #700 (woop)
  • Add support for feature set updates and remove versions #676 (zhilingc)
  • Feast configuration files refactored #611 (woop)

See Feast 0.5 Release Issue for more details.

Implemented enhancements:

  • Add general storage API and refactor existing store implementations #567 (zhilingc)
  • Add support for feature set updates and remove versions #676 (zhilingc)
  • Add unique ingestion id for all batch ingestions #656 (zhilingc)
  • Add storage interfaces #529 (zhilingc)
  • Add BigQuery storage implementation #546 (zhilingc)
  • Add Redis storage implementation #547 (zhilingc)
  • Add Support for Redis Cluster #502 (lavkesh)
  • Add Ingestion Job management API for Feast Core #548 (mrzzy)
  • Add feature and feature set labels for metadata #536 (imjuanleonard)
  • Update Python SDK so FeatureSet can import Schema from Tensorflow metadata #450 (davidheryanto)

Fixed bugs:

  • Add feature set status JOB_STARTING to denote feature sets waiting for job to get to RUNNING state #714 (zhilingc)
  • Remove feature set status check for job update requirement #708 (khorshuheng)
  • Fix Feast Core docker image #703 (khorshuheng)
  • Include server port config on the generated application.yml #696 (khorshuheng)
  • Fix typo in all types parquet yml file (e2e test) #683 (khorshuheng)
  • Add grpc health probe implementation to core #680 (zhilingc)
  • Ensure that generated python code are considered as module #679 (khorshuheng)
  • Fix DataflowJobManager to update existing job instance instead of creating new one #678 (zhilingc)
  • Fix config validation for feast.jobs.metrics.host #662 (davidheryanto)
  • Docker compose bug fix #661 (woop)
  • Swap join columns #647 (zhilingc)
  • Fix Feast Serving not registering its store in Feast Core #641 (mrzzy)
  • Kafka producer should raise an exception when it fails to connect to broker #636 (junhui096)

Merged pull requests:

v0.4.7 (2020-03-17)

Full Changelog

Merged pull requests:

v0.4.6 (2020-02-26)

Full Changelog

Merged pull requests:

  • Rename metric name for request latency in feast serving #488 (davidheryanto)
  • Allow use of secure gRPC in Feast Python client #459 (Yanson)
  • Extend WriteMetricsTransform in Ingestion to write feature value stats to StatsD #486 (davidheryanto)
  • Remove transaction from Ingestion #480 (imjuanleonard)
  • Fix fastavro version used in Feast to avoid Timestamp delta error #490 (davidheryanto)
  • Fail Spotless formatting check before tests execute #487 (ches)
  • Reduce refresh rate of specification refresh in Serving to 10 seconds #481 (woop)

v0.4.5 (2020-02-14)

Full Changelog

Merged pull requests:

v0.4.4 (2020-01-28)

Full Changelog

Merged pull requests:

  • Change RedisBackedJobService to use a connection pool #439 (zhilingc)
  • Update GKE installation and chart values to work with 0.4.3 #434 (lgvital)
  • Remove "resource" concept and the need to specify a kind in feature sets #432 (woop)
  • Add retry options to BigQuery #431 (Yanson)
  • Fix logging #430 (Yanson)
  • Add documentation for bigquery batch retrieval #428 (zhilingc)
  • Publish datatypes/java along with sdk/java #426 (ches)
  • Update basic Feast example to Feast 0.4 #424 (woop)
  • Introduce datatypes/java module for proto generation #391 (ches)

v0.4.3 (2020-01-08)

Full Changelog

Fixed bugs:

  • Bugfix for redis ingestion retries throwing NullPointerException on remote runners #417 (khorshuheng)

v0.4.2 (2020-01-07)

Full Changelog

Fixed bugs:

  • Missing argument in error string in ValidateFeatureRowDoFn #401

Merged pull requests:

  • Define maven revision property when packaging jars in Dockerfile so the images are built successfully #410 (davidheryanto)
  • Deduplicate rows in subquery #409 (zhilingc)
  • Filter out extra fields, deduplicate fields in ingestion #404 (zhilingc)
  • Automatic documentation generation for gRPC API #403 (woop)
  • Update feast core default values to include hibernate merge strategy #400 (zhilingc)
  • Move cli into feast package #398 (zhilingc)
  • Use Nexus staging plugin for deployment #394 (khorshuheng)
  • Handle retry for redis io flow #274 (khorshuheng)

v0.4.1 (2019-12-30)

Full Changelog

Merged pull requests:

v0.4.0 (2019-12-28)

Full Changelog

Implemented enhancements:

  • Edit description in feature specification to also reflect in BigQuery schema description. #239
  • Allow for disabling of metrics pushing #57

Merged pull requests:

v0.3.8 (2020-06-10)

Full Changelog

Implemented enhancements:

  • v0.3 backport: Add feature and feature set labels #737 (ches)

Merged pull requests:

  • v0.3 backport: Add Java coverage reporting #734 (ches)

v0.3.7 (2020-05-01)

Full Changelog

Merged pull requests:

v0.3.6 (2020-01-03)

Merged pull requests:

Full Changelog

  • Add support for file paths for providing entity rows during batch retrieval #375 (voonhous)

v0.3.5 (2019-12-26)

Full Changelog

Merged pull requests:

  • Always set destination table in BigQuery query config in Feast Batch Serving so it can handle large results #392 (davidheryanto)

v0.3.4 (2019-12-23)

Full Changelog

Merged pull requests:

  • Make redis key creation more determinisitic #380 (zhilingc)

v0.3.3 (2019-12-18)

Full Changelog

Implemented enhancements:

  • Added Docker Compose for Feast #272
  • Added ability to check import job status and cancel job through Python SDK #194
  • Added basic customer transactions example #354 (woop)

Merged pull requests:

  • Added Prow jobs to automate the release of Docker images and Python SDK #369 (davidheryanto)
  • Fixed installation link in README.md #368 (Jeffwan)
  • Fixed Java SDK tests not actually running (missing dependencies) #366 (woop)
  • Added more batch retrieval tests #357 (zhilingc)
  • Python SDK and Feast Core Bug Fixes #353 (woop)
  • Updated buildFeatureSets method in Golang SDK #351 (davidheryanto)
  • Python SDK cleanup #348 (woop)
  • Broke up queries for point in time correctness joins #347 (zhilingc)
  • Exports gRPC call metrics and Feast resource metrics in Core #345 (davidheryanto)
  • Fixed broken Google Group link on Community page #343 (ches)
  • Ensured ImportJobTest is not flaky by checking WriteToStore metric and requesting adequate resources for testing #332 (davidheryanto)
  • Added docker-compose file with Jupyter notebook #328 (khorshuheng)
  • Added minimal implementation of ingesting Parquet and CSV files #327 (voonhous)

v0.3.2 (2019-11-29)

Full Changelog

Merged pull requests:

  • Fixed incorrect BigQuery schema creation from FeatureSetSpec #340 (davidheryanto)
  • Filtered out feature sets that dont share the same source #339 (zhilingc)
  • Changed latency calculation method to not use Timer #338 (zhilingc)
  • Moved Prometheus annotations to pod template for serving #336 (zhilingc)
  • Removed metrics windowing, cleaned up step names for metrics writing #334 (zhilingc)
  • Set BigQuery table time partition inside get table function #333 (zhilingc)
  • Added unit test in Redis to return values with no max age set #329 (smadarasmi)
  • Consolidated jobs into single steps instead of branching out #326 (zhilingc)
  • Pinned Python SDK to minor versions for dependencies #322 (woop)
  • Added Auto format to Google style with Spotless #317 (ches)

v0.3.1 (2019-11-25)

Full Changelog

Merged pull requests:

v0.3.0 (2019-11-19)

Full Changelog

Summary:

  • Introduced "Feature Sets" as a concept with a new Feast Core API, Feast Serving API
  • Upgraded Python SDK to support new Feast API. Allows for management of Feast as a library or through the command line.
  • Implemented a Golang SDK and Java SDK to support the new Feast Core and Feast Serving APIs.
  • Added support for multi-feature set retrieval and joins.
  • Added point-in-time correct retrieval for both batch and online serving.
  • Added support for an external source in Kafka.
  • Added job management to Feast Core to manage ingestion/population jobs to remote Feast deployments
  • Added metric support through Prometheus

Merged pull requests:

  • Regenerate go protos #313 (zhilingc)
  • Bump chart version to 0.3.0 #311 (zhilingc)
  • Refactored Core API: ListFeatureSets, ListStore, and GetFeatureSet #309 (woop)
  • Use Maven's --also-make by default #308 (ches)
  • Python SDK Ingestion and schema inference updates #307 (woop)
  • Batch ingestion fix #299 (zhilingc)
  • Update values-demo.yaml to make Minikube installation simpler #298 (woop)
  • Fix bug in core not setting default Kafka source #297 (woop)
  • Replace Prometheus logging in ingestion with StatsD logging #293 (woop)
  • Feast Core: Stage files manually when launching Dataflow jobs #291 (davidheryanto)
  • Database tweaks #290 (smadarasmi)
  • Feast Helm charts and build script #289 (davidheryanto)
  • Fix max_age changes not updating specs and add TQDM silencing flag #292 (woop)
  • Ingestion fixes #286 (zhilingc)
  • Consolidate jobs #279 (zhilingc)
  • Import Spring Boot's dependency BOM, fix spring-boot:run at parent project level #276 (ches)
  • Feast 0.3 Continuous Integration (CI) Update #271 (davidheryanto)
  • Add batch feature retrieval to Python SDK #268 (woop)
  • Set Maven build requirements and some project POM metadata #267 (ches)
  • Python SDK enhancements #264 (woop)
  • Use a symlink for Java SDK's protos #263 (ches)
  • Clean up the Maven build #262 (ches)
  • Add golang SDK #261 (zhilingc)
  • Move storage configuration to serving #254 (zhilingc)
  • Serving API changes for 0.3 #253 (zhilingc)

v0.1.8 (2019-10-30)

Full Changelog

Implemented enhancements:

  • Feast cli config file should be settable by an env var #149
  • Helm chart for deploying feast using Flink as runner #64
  • Get ingestion metrics when running on Flink runner #63
  • Move source types into their own package and discover them using java.util.ServiceLoader #61
  • Change config to yaml #51
  • Ability to pass runner option during ingestion job submission #50

Fixed bugs:

  • Fix Print Method in Feast CLI #211
  • Dataflow monitoring by core is failing with incorrect job id #153
  • Feast core crashes without logger set #150

Merged pull requests:

v0.1.2 (2019-08-23)

Full Changelog

Fixed bugs:

  • Batch Import, feature with datetime format issue #203
  • Serving not correctly reporting readiness check if there is no activity #190
  • Serving stop periodically reloading feature specification after a while #188

Merged pull requests:

v0.1.1 (2019-04-18)

Full Changelog

Fixed bugs:

Merged pull requests:

v0.1.0 (2019-04-09)

Full Changelog

Implemented enhancements:

  • Removal of storing historical value of feature in serving storage #53
  • Remove feature "granularity" and relegate to metadata #17

Closed issues:

  • Add ability to name an import job #167
  • Ingestion retrying an invalid FeatureRow endlessly #163
  • Ability to associate data ingested in Warehouse store to its ingestion job #145
  • Missing (Fixing) unit test for FeatureRowKafkaIO #132

Merged pull requests:

v0.0.2 (2019-03-11)

Full Changelog

Implemented enhancements:

  • Coalesce FeatureRows for improved "latest" value consistency in serving stores #88
  • Kafka source #22

Closed issues:

  • Preload Feast's spec in serving cache #151
  • Feast csv data upload job #137
  • Blocking call to start feast ingestion job #136
  • Python SDK fails to apply feature when submitting job #134
  • Default dump format should be changed for Python SDK #133
  • Listing resources and finding out system state #131
  • Reorganise ingestion store classes to match architecture #109

v0.0.1 (2019-02-11)

Full Changelog

Implemented enhancements:

  • Spring boot CLI logs show up as JSON #104
  • Allow for registering feature that doesn't have warehouse store #5

Fixed bugs:

  • Error when submitting large import spec #125
  • Ingestion is not ignoring unknown feature in streaming source #99
  • Vulnerability in dependency (core - jackson-databind ) #92
  • TF file for cloud build trigger broken #72
  • Job Execution Failure with NullPointerException #46
  • Runtime Dependency Error After Upgrade to Beam 2.9.0 #44
  • [FlinkRunner] Core should not follow remote flink runner job to completion #21
  • Go packages in protos use incorrect repo #16

Merged pull requests:

  • Disable test during docker image creation #129 (pradithya)
  • Repackage helm chart #127 (pradithya)
  • Increase the column size for storing raw import spec #126 (pradithya)
  • Update Helm Charts (Redis, Logging) #123 (woop)
  • Added LOG_TYPE environmental variable #120 (woop)
  • Fix missing Redis write #119 (pradithya)
  • add logging when error on request feature #117 (pradithya)
  • run yarn run build during generate-resource #115 (pradithya)
  • Add loadBalancerSourceRanges option for both serving and core #114 (zhilingc)
  • Build master #112 (pradithya)
  • Cleanup warning while building proto files #108 (pradithya)
  • Embed ui build & packaging into core's build #106 (pradithya)
  • Add build badge to README #103 (woop)
  • Ignore features in FeatureRow if it's not requested in import spec #101 (pradithya)
  • Add override for serving service static ip #100 (zhilingc)
  • Fix go test #97 (zhilingc)
  • add missing copyright headers and fix test fail due to previous merge #95 (tims)
  • Allow submission of kafka jobs #94 (zhilingc)
  • upgrade jackson databind for security vulnerability #93 (tims)
  • Version revert #91 (zhilingc)
  • Fix validating feature row when the associated feature spec has no warehouse store #90 (pradithya)
  • Add get command #85 (zhilingc)
  • Avoid error thrown when no storage for warehouse/serving is registered #83 (pradithya)
  • Fix jackson dependency issue #82 (zhilingc)
  • Allow registration of feature without warehouse store #80 (pradithya)
  • Remove branch from cloud build trigger #79 (woop)
  • move read transforms into "source" package as FeatureSources #74 (tims)
  • Fix tag regex in tf file #73 (zhilingc)
  • Update charts #71 (mansiib)
  • Deduplicate storage ids before we fetch them #68 (tims)
  • Check the size of result against deduplicated request #67 (pradithya)
  • Add ability to submit ingestion job using Flink #62 (pradithya)
  • Fix vulnerabilities for webpack-dev #59 (budi)
  • Build push #56 (zhilingc)
  • Fix github vulnerability issue with webpack #54 (budi)
  • Only lookup storage specs that we actually need #52 (tims)
  • Link Python SDK RFC to PR and Issue #49 (woop)
  • Python SDK #47 (zhilingc)
  • Update com.google.httpclient to be same as Beam's dependency #45 (pradithya)
  • Bump Beam SDK to 2.9.0 #43 (pradithya)
  • Add fix for tests failing in docker image #40 (zhilingc)
  • Change error store to be part of configuration instead #39 (zhilingc)
  • Fix location of Prow's Tide configuration #35 (woop)
  • Add testing folder for deploying test infrastructure and running tests #34 (woop)
  • skeleton contributing guide #33 (tims)
  • allow empty string to select a NoOp write transform #30 (tims)
  • Remove packaging ingestion as separate profile (fix #28) #29 (pradithya)
  • Change gopath to point to feast-dev repo #26 (zhilingc)
  • Fixes #31 - errors during kafka deserializer (passing) test execution #25 (baskaranz)
  • Kafka IO fixes #23 (tims)
  • KafkaIO implementation for feast #19 (baskaranz)
  • Return same type string for warehouse and serving NoOp stores #18 (tims)
  • #12: prefetch specs and validate on job expansion #15 (tims)
  • Added RFC for Feast Python SDK #14 (woop)
  • Add more validation in feature spec registration #11 (pradithya)
  • Added rfcs/ folder with readme and template #10 (woop)
  • Expose ui service rpc #9 (pradithya)
  • Add Feast overview to README #8 (woop)
  • Directory structure changes #7 (zhilingc)
  • Change register to apply #4 (zhilingc)
  • Empty response handling in serving api #3 (pradithya)
  • Proto file fixes #1 (pradithya)