feat: Go server#2339

Merged

feast-ci-bot merged 181 commits intofeast-dev:masterfrom

ctkhanhly:go_server

Mar 8, 2022

Commits on Mar 8, 2022

Remove sdk/go

Tsotne Tabidze
authored and
achals
committed
Add interfaces and overall skeleton (incl working protobufs)

Tsotne Tabidze
authored and
achals
committed
Wire up FeatureStore & OnlineStore, implement RedisOnlineStore constructor, add tests

Tsotne Tabidze
authored and
achals
committed
Introduce RepoConfig struct instead of using raw map[string]interface{}

Tsotne Tabidze
authored and
achals
committed
Pass feast project name to RedisOnlineStore

Tsotne Tabidze
authored and
achals
committed
Add Redis Online Read Test

Willem Pienaar
authored and
achals
committed
Implement gRPC server start logic

Tsotne Tabidze
authored and
achals
committed
Update OnlineRead interface

Willem Pienaar
authored and
achals
committed
Redis reader with hashing implemented

Willem Pienaar
authored and
achals
committed
added implementation for GetOnlineFeatures in featurestore and a simple test

Ly Cao
authored and
achals
committed
Iterate on key building

Willem Pienaar
authored and
achals
committed
Implement gRPC server

Tsotne Tabidze
authored and
achals
committed
Fix some warnings

Tsotne Tabidze
authored and
achals
committed
Fix bugs & tests

Tsotne Tabidze
authored and
achals
committed
Implement redis key builder and reader

Willem Pienaar
authored and
achals
committed
Add more TODO comments

Willem Pienaar
authored and
achals
committed
Rebuilt protos

Willem Pienaar
authored and
achals
committed
Ignore read test

Willem Pienaar
authored and
achals
committed
Add more TODO comments

woop
authored and
achals
committed
Clean up serialize function

woop
authored and
achals
committed
fixed GetOnlineFeatures to so that each EntityKey is a row in the first param of OnlineRead, added values to SerializeValue

Ly Cao
authored and
achals
committed
Remove comment

woop
authored and
achals
committed
return copy of Features from OnlineStore instead of reusing original copy + add response for OnlineStore

Ly Cao
authored and
achals
committed
Delete go/protos directory from git, since it's in .gitignore

Tsotne Tabidze
authored and
achals
committed
Fix go/server compilation

Tsotne Tabidze
authored and
achals
committed
Add integration test

woop
authored and
achals
committed
added http json endpoint + add validation for feature names and entity keys for each requested feature view in GetOnlineFeatures

Ly Cao
authored and
achals
committed
Call go subprocess from Python

Tsotne Tabidze
authored and
achals
committed
fixed GetOnlineFeatures bug

Ly Cao
authored and
achals
committed
removed grpc-gateway + add go http server on fs.serve()

Ly Cao
authored and
achals
committed
experimenting python connector

Ly Cao
authored and
achals
committed
working version of python connector

Ly Cao
authored and
achals
committed
fixed python connector error + add a script to build plugin binary

Ly Cao
authored and
achals
committed
added a simple connector config type to RepoConfig in python sdk to support feast alpha enable go_feature_server

Ly Cao
authored and
achals
committed
migrating python's sdk get_online_features and its helper functions

Ly Cao
authored and
achals
committed
added redis pipeline + passed go tests, haven't tested feature service

Ly Cao
authored and
achals
committed
added integration test w/o odfv + dummy entity

Ly Cao
authored and
achals
committed
accidentally removed entity from request

Ly Cao
authored and
achals
committed
passed integration test

Ly Cao
authored and
achals
committed
first go server clean version, keep python functions. Next commit will diverge from python function calls for more optimized calls

Ly Cao
authored and
achals
committed
added 'optimized' functions

Ly Cao
authored and
achals
committed
added goroutines to OnlineRead

Ly Cao
authored and
achals
committed
added goroutines to redis OnlineRead, getFeaturesToUse, getEntityMaps and entity struct

Ly Cao
authored and
achals
committed
Ensure the correct tests are run for the go feature server

felixwang9817
authored and
achals
committed
Format and lint

felixwang9817
authored and
achals
committed
Remove Go feature server implementation of Python feature server

felixwang9817
authored and
achals
committed
Remove incorrect comments

felixwang9817
authored and
achals
committed
Clean up Go feature server test logic

felixwang9817
authored and
achals
committed
Add docstrings for GoServer class

felixwang9817
authored and
achals
committed
Remove unused GoServerError

felixwang9817
authored and
achals
committed
Remove unused ConnectorOnlineStore

felixwang9817
authored and
achals
committed
Run Go feature server tests separately from main integration tests

felixwang9817
authored and
achals
committed
lint-go + cleaned go code + handle BrokenPipeError in go_server.py

Ly Cao
authored and
achals
committed
added create ./go/protos to compile-protos-go in Makefile

Ly Cao
authored and
achals
committed
removed 1 unneeded comment

Ly Cao
authored and
achals
committed
fix small bug in go_server raise if error is not brokenpipe in stop function

Ly Cao
authored and
achals
committed
Add Snowflake back in for Go feature server tests

felixwang9817
authored and
achals
committed
formatted go

Ly Cao
authored and
achals
committed
Add CI for Go integration tests

felixwang9817
authored and
achals
committed
Modify setup.py to build Go protos and clean up Makefile

felixwang9817
authored and
achals
committed
Move go build logic to a different file to not trigger on pip install

felixwang9817
authored and
achals
committed
Fix Go protoc command

felixwang9817
authored and
achals
committed
separated create config from json and yaml + changed go server _connect method name + add TODO to user proper logging + fix go_server exception on stop() + change go layout

Ly Cao
authored and
achals
committed
added go server lifecycle test + local infra for go server + experiment with new go server implementations

Ly Cao
authored and
achals
committed
Only run Go tests on FileSource

felixwang9817
authored and
achals
committed
Fix Makefile commands

felixwang9817
authored and
achals
committed
fixed test to use go_feature_server flag in test + added option to 2 go server implementations + fix parsedKind

Ly Cao
authored and
achals
committed
fixed goserverlifecyle test implementation

Ly Cao
authored and
achals
committed
fixed goserverlifecycle --- still need to review this test

Ly Cao
authored and
achals
committed
added a command to test goserver with thread, works in reasonable time now but need to review go server thread implementation

Ly Cao
authored and
achals
committed
Print output

felixwang9817
authored and
achals
committed
Clean up Makefile and fix errors in setup.py

felixwang9817
authored and
achals
committed
Pin Golang protobuf dependency to specific version

felixwang9817
authored and
achals
committed
Format + lint

felixwang9817
authored and
achals
committed
Revert previous change

felixwang9817
authored and
achals
committed
Add back Python version

felixwang9817
authored and
achals
committed
Fix test errors due to rebase

felixwang9817
authored and
achals
committed
Add Go version to unit test workflow

felixwang9817
authored and
achals
committed
Fix .gitignore

felixwang9817
authored and
achals
committed
Format + lint

felixwang9817
authored and
achals
committed
Add setup Go action to set correct Go version for unit tests

felixwang9817
authored and
achals
committed
Test Gopath in workflow

felixwang9817
authored and
achals
committed
Add Github action for installing protoc during unit tests

felixwang9817
authored and
achals
committed
Print stderr for Go proto generation

felixwang9817
authored and
achals
committed
Check for PATH and GOBIN in unit tests

felixwang9817
authored and
achals
committed
Lint

felixwang9817
authored and
achals
committed
Switch from using protoc binary for Go protos to grpcio-tools

felixwang9817
authored and
achals
committed
Add psutil==5.9.0 dependency for test_go_server_life_cycle test

felixwang9817
authored and
achals
committed
Specify Go version during Github actions

felixwang9817
authored and
achals
committed
Add back protoc setup Github action

felixwang9817
authored and
achals
committed
Add GOPATH to GITHUB_PATH so that protoc-gen-go is discovered

felixwang9817
authored and
achals
committed
Set PATH so that protoc-gen-go can be found

felixwang9817
authored and
achals
committed
Update Python3.7 ci-requirements file

felixwang9817
authored and
achals
committed
Update all requirements

felixwang9817
authored and
achals
committed
Fix test

felixwang9817
authored and
achals
committed
Fix protoc-gen-go bug for all workflows

felixwang9817
authored and
achals
committed
Clean up existing test and mark new test as integration

felixwang9817
authored and
achals
committed
Lint

felixwang9817
authored and
achals
committed
Correctly set GOPATH in workflows

felixwang9817
authored and
achals
committed
Modify AWS Lambda Dockerfile to copy the necessary Go files

felixwang9817
authored and
achals
committed
merge infra package into feast package

Ly Cao
authored and
achals
committed
optimized go server + address some PR comments

Ly Cao
authored and
achals
committed
added newServingServiceServer to comply with the rest of the code style

Ly Cao
authored and
achals
committed
removed an extra err check

Ly Cao
authored and
achals
committed
added pre-allocation to online response metadata

Ly Cao
authored and
achals
committed
Fix protoc compilation for go and use a unix domain socket file
achals
committed
Use a flag for compilation
achals
committed
Change flag in
achals
committed
fix: Remove redis service to prevent more conflicts and add redis node to master_only (#2354)

kevjumba
authored and
achals
committed
fix: Added additional value types to UI parser and removed references to registry-bq.json (#2361)

authored and
achals
committed
fix:revert back to jdk 11 for datatypes package

adchia
authored and
achals
committed
fix:upgrade feast ui packages to fix critical vulnerabilities

adchia
authored and
achals
committed
ci: Add support for semantic release (#2332)

woop
authored and
achals
committed
feat: Allow all snowflake python connector connection methods to be available to Feast (#2356)

sfc-gh-madkins
authored and
achals
committed
fix: Fix Redshift bug that stops waiting on statements after 5 minutes (#2363)

Tsotne Tabidze
authored and
achals
committed
feat: Feast Spark Offline Store (#2349)

authored and
achals
committed
ci: Update versions of helm charts + java pom files

adchia
authored and
achals
committed
feat: Event timestamps response (#2355)

Vitaly Sergeyev
authored and
achals
committed
feat: Metadata changes & making data sources top level objects to power Feast UI (#2336)

adchia
authored and
achals
committed
ci: Remove buggy branch identification

woop
authored and
achals
committed
fix action and set go version
achals
committed
Complie python protos correctly
achals
committed
Set up go in the pr integration test workflow
achals
committed
Nuke go requirements for python ci (for the moment)
achals
committed
Update redis port
achals
committed
ci: Add version bump script

woop
authored and
achals
committed
ci: Fix broken release preparation

woop
authored and
achals
committed
ci: Add ci bot as committer and fix typo in dry-run config

feast-ci-bot
authored and
achals
committed
chore(release): release 0.19.0

feast-ci-bot
authored and
achals
committed
chore: Fix changelog and disable release comments

woop
authored and
achals
committed
fix: Fix unhashable Snowflake and Redshift sources

woop
authored and
achals
committed
chore: Remove needs-kind and release not requirement

woop
authored and
achals
committed
chore: Remove release note block

woop
authored and
achals
committed
ci: Uncheck prerelease status for patch releases

woop
authored and
achals
committed
fix: Fix default feast apply path without any extras (#2373)

adchia
authored and
achals
committed
docs: Add short section about github actions (#2315)

kevjumba
authored and
achals
committed
fix: Use the correct dockerhub image tag when building feature servers (#2372)
achals
committed
compile go as part of python ci setup
achals
committed
set path with gopath/bin
achals
committed
Set path for commands correctly
achals
committed
Set up go for lint-go
achals
committed
Remove makefile stuff
achals
committed
Fix workflows and Makefile commands
achals
committed
protoc-gen-go-grpc
achals
committed
install go deps first
achals
committed
Compile go protos as well
achals
committed
Remove go mod tidy from the deps target
achals
committed
Better python tooling
achals
committed
Remove container
achals
committed
Upgrade lint go as well
achals
committed
Upgrade lint go as well
achals
committed
More logging for unit-go
achals
committed
Install using python setup.py develop
achals
committed
install-python-ci-dependencies
achals
committed
Skip tests that need a feature repo
achals
committed
Skip a scary forking test
achals
committed
Remove all the crusty port stuff and disable the lifecycle test
achals
committed
Remove more crusty port stuff
achals
committed
Update skip message
achals
committed
Introduce a sleep before reading values
achals
committed
Disable one more test configuration since background thread-based monitoring doesn't currently work
achals
committed
Disable the test entirely
achals
committed
ci: Add support for semantic release (#2332)

woop
authored and
achals
committed
feat: Feast Spark Offline Store (#2349)

authored and
achals
committed
ci: Update versions of helm charts + java pom files

adchia
authored and
achals
committed
feat: Metadata changes & making data sources top level objects to power Feast UI (#2336)

adchia
authored and
achals
committed
ci: Remove buggy branch identification

woop
authored and
achals
committed
ci: Add version bump script

woop
authored and
achals
committed
ci: Fix broken release preparation

woop
authored and
achals
committed
ci: Add ci bot as committer and fix typo in dry-run config

feast-ci-bot
authored and
achals
committed
chore(release): release 0.19.0

feast-ci-bot
authored and
achals
committed
chore: Fix changelog and disable release comments

woop
authored and
achals
committed
ci: Uncheck prerelease status for patch releases

woop
authored and
achals
committed
fix: Fix default feast apply path without any extras (#2373)

adchia
authored and
achals
committed
fix: Making a name for data sources not a breaking change (#2379)

adchia
authored and
achals
committed
fix: Update some fields optional in UI parser (#2380)

authored and
achals
committed
fix: Fix spark docs (#2382)

authored and
achals
committed
feat: Makefile for contrib for Issue #2364 (#2366)

authored and
achals
committed
Closes threadpool resources upon datastore online_write_batch completion (#2386)

ptoman-pa
authored and
achals
committed
CR comments
achals
committed
Merge from master again
achals
committed