Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / feast-dev/feast-spark issues and pull requests

#158 - Fix pipeline error while using Redis cluster

Pull Request - State: closed - Opened by khorshuheng about 2 years ago - 1 comment
Labels: size/XS, approved

#157 - Initialize cluster provider / jedis pool only once

Pull Request - State: closed - Opened by khorshuheng over 2 years ago - 1 comment
Labels: size/L, approved

#156 - Add option for stencil token

Pull Request - State: closed - Opened by khorshuheng over 2 years ago - 1 comment
Labels: size/M, approved

#155 - Ignore cancelled job

Pull Request - State: closed - Opened by khorshuheng over 2 years ago - 1 comment
Labels: size/XS, approved

#154 - Revert changes on pipeline connection initialization

Pull Request - State: closed - Opened by khorshuheng over 2 years ago - 1 comment
Labels: size/L, approved

#153 - Refactor validation spec

Pull Request - State: closed - Opened by khorshuheng over 2 years ago - 1 comment
Labels: size/L, approved

#152 - Instantiate Jedis client lazily and only once per JVM process

Pull Request - State: closed - Opened by khorshuheng over 2 years ago - 1 comment
Labels: size/S, approved

#151 - Include protos in repository

Pull Request - State: closed - Opened by khorshuheng over 2 years ago - 1 comment
Labels: size/XXL, approved

#150 - Update feast dependency to 0.9.7

Pull Request - State: closed - Opened by khorshuheng over 2 years ago - 2 comments
Labels: size/S, approved

#149 - Paritioned entity source

Pull Request - State: closed - Opened by khorshuheng over 2 years ago - 1 comment
Labels: size/M, approved

#148 - implement data validation scala to avoid python dependencies

Pull Request - State: closed - Opened by keshav2211 over 2 years ago - 3 comments
Labels: size/L, ok-to-test

#147 - Prevent crashing when job was deleted externally

Pull Request - State: closed - Opened by khorshuheng over 2 years ago - 1 comment
Labels: size/S, approved

#146 - Persist information on whether an endpoint is in cluster mode or not

Pull Request - State: closed - Opened by khorshuheng over 2 years ago - 2 comments
Labels: size/S, approved

#145 - [DAT-1492] Make bigtable keys deterministic

Pull Request - State: closed - Opened by khorshuheng over 2 years ago - 1 comment
Labels: size/XS, approved

#144 - Retry connection failure while instantiating connection provider

Pull Request - State: closed - Opened by khorshuheng over 2 years ago - 2 comments
Labels: size/L, approved

#143 - Deprecate whitelist for non streaming jobs

Pull Request - State: closed - Opened by khorshuheng over 2 years ago - 1 comment
Labels: size/L, approved

#142 - Remove azure references in feast spark

Pull Request - State: closed - Opened by khorshuheng over 2 years ago - 1 comment
Labels: size/L, approved

#141 - clean up e2e tests

Pull Request - State: open - Opened by khorshuheng over 2 years ago - 2 comments
Labels: size/XXL, approved

#140 - Set handler call logging level to debug

Pull Request - State: closed - Opened by khorshuheng over 2 years ago - 1 comment
Labels: size/XS, approved

#139 - Remove replace BQ source with view

Pull Request - State: closed - Opened by khorshuheng over 2 years ago - 1 comment
Labels: size/M, approved

#138 - Make bigtable storage location consistent

Pull Request - State: closed - Opened by khorshuheng over 2 years ago - 1 comment
Labels: size/XS, approved

#137 - Bundle python dependencies for spark images

Pull Request - State: closed - Opened by khorshuheng over 2 years ago - 2 comments
Labels: size/S, approved

#136 - Update jobservice base image

Pull Request - State: closed - Opened by khorshuheng over 2 years ago - 1 comment
Labels: size/S, approved

#135 - lock manager for job service

Pull Request - State: closed - Opened by keshav2211 over 2 years ago - 2 comments
Labels: size/L, needs-ok-to-test

#134 - Upgrade spark version

Pull Request - State: closed - Opened by khorshuheng over 2 years ago - 1 comment
Labels: size/M, approved

#133 - Perform data type conversion automatically

Pull Request - State: closed - Opened by khorshuheng over 2 years ago - 1 comment
Labels: size/L, approved

#132 - Update version to v0.2.24

Pull Request - State: closed - Opened by khorshuheng over 2 years ago - 1 comment
Labels: size/S, approved

#131 - Exclude healthcheck calls from logging interceptor

Pull Request - State: closed - Opened by khorshuheng over 2 years ago - 1 comment
Labels: size/XS, approved

#130 - Make job hashing order agnostic

Pull Request - State: closed - Opened by khorshuheng over 2 years ago - 3 comments
Labels: size/M, approved

#129 - update github action

Pull Request - State: closed - Opened by khorshuheng over 2 years ago - 2 comments
Labels: size/S, approved

#128 - update version to 0.2.23

Pull Request - State: closed - Opened by khorshuheng over 2 years ago - 2 comments
Labels: size/S, approved

#127 - add project label

Pull Request - State: closed - Opened by khorshuheng over 2 years ago - 1 comment
Labels: size/XS, approved

#126 - Update logic to triage healthy ingestion jobs

Pull Request - State: closed - Opened by terryyylim over 2 years ago - 2 comments
Labels: size/XS, kind/feature, lgtm, approved, ok-to-test

#125 - Add Redis write properties

Pull Request - State: closed - Opened by khorshuheng over 2 years ago - 2 comments
Labels: size/M, approved

#124 - update version to 0.2.22

Pull Request - State: closed - Opened by khorshuheng over 2 years ago - 2 comments
Labels: do-not-merge/release-note-label-needed, needs-kind, size/S, approved

#123 - whitelist job request based on configuration

Pull Request - State: closed - Opened by khorshuheng over 2 years ago - 2 comments
Labels: do-not-merge/release-note-label-needed, needs-kind, size/M, approved

#122 - Update last processed event timestamp

Pull Request - State: closed - Opened by terryyylim over 2 years ago - 2 comments
Labels: size/XS, release-note-none, kind/bug, lgtm, approved, ok-to-test

#121 - update dns cache ttl

Pull Request - State: closed - Opened by khorshuheng over 2 years ago - 2 comments
Labels: do-not-merge/release-note-label-needed, needs-kind, size/XS, approved

#120 - Add last processed event timestamp to streaming job

Pull Request - State: closed - Opened by terryyylim over 2 years ago - 3 comments
Labels: release-note-none, size/S, kind/feature, lgtm, approved, ok-to-test

#119 - Convert maxage duration protobuf for health metric

Pull Request - State: closed - Opened by terryyylim over 2 years ago - 2 comments
Labels: size/XS, release-note-none, kind/bug, lgtm, approved

#118 - update version to 0.2.21

Pull Request - State: closed - Opened by khorshuheng over 2 years ago - 2 comments
Labels: do-not-merge/release-note-label-needed, needs-kind, size/M, approved

#117 - update version to 0.2.20

Pull Request - State: closed - Opened by khorshuheng over 2 years ago - 3 comments
Labels: do-not-merge/release-note-label-needed, needs-kind, size/S, approved

#116 - clean up Jedis connection after use

Pull Request - State: closed - Opened by khorshuheng over 2 years ago - 3 comments
Labels: do-not-merge/release-note-label-needed, needs-kind, size/M, approved

#115 - Add ingestion job health metrics retrieval

Pull Request - State: closed - Opened by terryyylim over 2 years ago - 6 comments
Labels: kind/feature, size/L, release-note, lgtm, approved, ok-to-test

#114 - update version to 0.2.19

Pull Request - State: closed - Opened by khorshuheng over 2 years ago - 2 comments
Labels: do-not-merge/release-note-label-needed, needs-kind, size/S, approved

#112 - detect whether cluster is available by cluster command

Pull Request - State: closed - Opened by khorshuheng over 2 years ago - 2 comments
Labels: do-not-merge/release-note-label-needed, needs-kind, size/S, approved

#111 - update version to 0.2.18

Pull Request - State: closed - Opened by khorshuheng over 2 years ago - 2 comments
Labels: do-not-merge/release-note-label-needed, needs-kind, size/S, approved

#110 - add config setting for whitelisting feast job types

Pull Request - State: closed - Opened by keshav2211 over 2 years ago - 4 comments
Labels: needs-kind, size/M, release-note, lgtm, ok-to-test

#109 - Reduce redis hash map memory foot print

Pull Request - State: closed - Opened by khorshuheng over 2 years ago - 1 comment
Labels: needs-kind, size/L, release-note, approved

#108 - Hash entity keys

Pull Request - State: closed - Opened by khorshuheng over 2 years ago - 2 comments
Labels: do-not-merge/release-note-label-needed, needs-kind, size/L, approved

#107 - Refactor Spark ingestion to use Jedis instead of Spark Redis

Pull Request - State: closed - Opened by khorshuheng over 2 years ago - 2 comments
Labels: needs-kind, release-note-none, size/L, approved

#106 - add support for redis auth

Pull Request - State: closed - Opened by khorshuheng over 2 years ago - 4 comments
Labels: needs-kind, size/L, release-note, approved

#103 - Upgrade version to 0.2.17

Pull Request - State: closed - Opened by khorshuheng almost 3 years ago - 3 comments
Labels: do-not-merge/release-note-label-needed, needs-kind, size/S, approved

#102 - Add prometheus metrics to jobservice

Pull Request - State: closed - Opened by khorshuheng almost 3 years ago - 5 comments
Labels: needs-kind, release-note-none, size/M, approved

#101 - ability to whitelist on feature table level

Pull Request - State: closed - Opened by khorshuheng almost 3 years ago - 2 comments
Labels: needs-kind, size/L, release-note, approved

#100 - Update README.md

Pull Request - State: open - Opened by alashti almost 3 years ago - 3 comments
Labels: do-not-merge/release-note-label-needed, needs-kind, size/XS, needs-ok-to-test

#99 - Configurable templates by job type for spark kubernetes jobs

Pull Request - State: closed - Opened by pyalex almost 3 years ago - 5 comments
Labels: release-note-none, kind/feature, size/M, approved

#98 - Enable sql expression evaluation in fieldMapping for historical retrieval

Pull Request - State: closed - Opened by pyalex about 3 years ago - 2 comments
Labels: release-note-none, size/S, kind/housekeeping, approved

#97 - Fix setup requirement

Pull Request - State: closed - Opened by khorshuheng about 3 years ago - 3 comments
Labels: size/XS, kind/bug, approved

#96 - Remove spark bigquery package download at run time

Pull Request - State: closed - Opened by khorshuheng about 3 years ago - 2 comments
Labels: release-note-none, size/S, kind/bug, approved

#95 - Add streaming metrics

Pull Request - State: closed - Opened by khorshuheng about 3 years ago - 2 comments
Labels: kind/feature, size/L, release-note, approved

#94 - guide error

Issue - State: closed - Opened by 777ki about 3 years ago

#93 - Keep only unique entity rows in entity dataframe in historical retrieval job

Pull Request - State: closed - Opened by pyalex about 3 years ago - 2 comments
Labels: release-note-none, size/S, kind/housekeeping, approved

#92 - Add checkpoint in each iteration of join loop (historical retrieval job) to truncate logical plan

Pull Request - State: closed - Opened by pyalex about 3 years ago - 2 comments
Labels: size/XS, release-note-none, kind/housekeeping, approved

#91 - Add persistent checkpoint to historical retrieval spark job

Pull Request - State: closed - Opened by pyalex about 3 years ago - 2 comments
Labels: release-note-none, size/S, kind/housekeeping, approved

#90 - Omit skewness in spark join by broadcasting entity dataframe

Pull Request - State: closed - Opened by pyalex about 3 years ago - 3 comments
Labels: release-note-none, size/S, kind/housekeeping, lgtm, approved

#89 - Speed-up join in historical retrieval by replacing pandas with native spark

Pull Request - State: closed - Opened by pyalex about 3 years ago - 2 comments
Labels: release-note-none, kind/housekeeping, size/L, approved

#88 - Pandas is missing in spark job base image

Pull Request - State: closed - Opened by pyalex about 3 years ago - 2 comments
Labels: release-note-none, size/S, kind/bug, approved

#87 - Optimize historical retrieval by filtering rows only within timestamp boundaries from entity dataframe

Pull Request - State: closed - Opened by pyalex about 3 years ago - 2 comments
Labels: release-note-none, kind/housekeeping, size/M, approved

#86 - Do not use gcThreshold for historical retrieval jobs

Pull Request - State: closed - Opened by pyalex about 3 years ago - 2 comments
Labels: release-note-none, size/S, kind/bug, approved

#85 - Fix mypy-protobuf version requirement for setup

Pull Request - State: closed - Opened by khorshuheng about 3 years ago - 3 comments
Labels: do-not-merge/release-note-label-needed, needs-kind, size/XS, approved

#84 - Fix mypy-protobuf version requirement

Pull Request - State: closed - Opened by khorshuheng about 3 years ago - 2 comments
Labels: size/XS, release-note-none, kind/housekeeping

#83 - Refresh redis topology on write

Pull Request - State: closed - Opened by khorshuheng about 3 years ago - 4 comments
Labels: size/S, kind/bug, release-note, approved

#82 - Use gcThresholdSec label (if present) instead of maxAge for feature TTL in storage

Pull Request - State: closed - Opened by pyalex about 3 years ago - 2 comments
Labels: release-note-none, size/S, kind/feature, approved

#81 - Make max inflight RPCs in bigtable client configurable through spark config

Pull Request - State: closed - Opened by pyalex about 3 years ago - 4 comments
Labels: size/XS, release-note-none, kind/housekeeping, approved

#80 - Use hash for schedule job id

Pull Request - State: closed - Opened by khorshuheng about 3 years ago - 5 comments
Labels: size/S, kind/housekeeping, release-note, lgtm, approved

#79 - Use entity source project dataset for bigquery view creation

Pull Request - State: closed - Opened by khorshuheng over 3 years ago - 3 comments
Labels: kind/bug, size/M, release-note, lgtm, approved

#78 - Extra configuration for bigtable client

Pull Request - State: closed - Opened by pyalex over 3 years ago - 2 comments
Labels: release-note-none, kind/housekeeping, size/M, approved

#77 - Add configuration for bigquery entity staging location

Pull Request - State: closed - Opened by khorshuheng over 3 years ago - 4 comments
Labels: needs-kind, size/M, release-note, lgtm, approved

#76 - Add Azure Databricks as a spark launcher

Pull Request - State: closed - Opened by SHARANTANGEDA over 3 years ago - 3 comments
Labels: needs-kind, size/XXL, release-note-action-required

#75 - Flush Ingestion Job termination log into kubernetes compatible destination

Pull Request - State: closed - Opened by pyalex over 3 years ago - 2 comments
Labels: release-note-none, kind/feature, size/M, approved

#74 - Log spark retrieval error message

Pull Request - State: closed - Opened by terryyylim over 3 years ago - 5 comments
Labels: release-note-none, kind/feature, size/M, lgtm, approved, ok-to-test

#73 - py-spark image tag version is 3.0.2 instead of v3.0.2 on gcr.io

Issue - State: closed - Opened by sedflix over 3 years ago

#72 - Fix broken scheduled batch ingestion jobs

Pull Request - State: closed - Opened by khorshuheng over 3 years ago - 3 comments
Labels: kind/bug, size/M, release-note, lgtm, approved

#71 - Test long entity names in e2e tests

Pull Request - State: closed - Opened by pyalex over 3 years ago - 1 comment
Labels: release-note-none, size/S, kind/housekeeping, approved

#70 - Fix SSTable name length restrictions during ingestion

Pull Request - State: closed - Opened by terryyylim over 3 years ago - 3 comments
Labels: release-note-none, kind/bug, size/M, lgtm, approved, ok-to-test

#69 - Batch Ingestion job is stuck after exception thrown

Pull Request - State: closed - Opened by pyalex over 3 years ago - 3 comments
Labels: size/XS, release-note-none, kind/bug, lgtm, approved

#68 - Update redis host for e2e tests

Pull Request - State: closed - Opened by khorshuheng over 3 years ago - 3 comments
Labels: size/XS, release-note-none, kind/housekeeping, lgtm, approved

#67 - Bigtable sink (row level) metrics

Pull Request - State: closed - Opened by pyalex over 3 years ago - 1 comment
Labels: release-note-none, kind/housekeeping, size/M, approved

#66 - Call admin.modifyTable only if table spec changes: preventing quota to be exceeded

Pull Request - State: closed - Opened by pyalex over 3 years ago - 3 comments
Labels: release-note-none, kind/bug, size/M, lgtm, approved

#65 - Explicitly stop sparkSession on exception to prevent it stucking

Pull Request - State: closed - Opened by pyalex over 3 years ago - 2 comments
Labels: size/XS, release-note-none, kind/housekeeping, approved

#64 - Bump hadoop aws version to 3.2.0 for local launcher

Pull Request - State: open - Opened by unit7-0 over 3 years ago - 2 comments
Labels: needs-kind, size/XS, release-note-none, needs-ok-to-test

#62 - Migrate sparkop e2e tests to kf-feast cluster

Pull Request - State: closed - Opened by khorshuheng over 3 years ago - 5 comments
Labels: needs-kind, release-note-none, size/L, approved

#61 - Add Synapse Launcher

Pull Request - State: open - Opened by xiaoyongzhu over 3 years ago - 4 comments
Labels: needs-kind, size/XL, release-note, ok-to-test

#59 - Support for Schedule Spark Application

Pull Request - State: closed - Opened by khorshuheng over 3 years ago - 15 comments
Labels: kind/feature, size/XL, release-note, lgtm, approved

#14 - Add jar builder GitHub action + SDK integration tests

Pull Request - State: open - Opened by oavdeev over 3 years ago - 2 comments
Labels: needs-kind, release-note-none, size/L