awslabs/kinesis-kafka-connector issues and pull requests

#86 - Support kafka message headers

Issue - State: open - Opened by michaelwagler 8 months ago

#85 - Support for Individual AWS Credentials in Kinesis Connector Sink

Issue - State: open - Opened by copernicium-112 11 months ago

#84 - Versions updated to fix vulnerabilities

Pull Request - State: open - Opened by brunoselvacj about 1 year ago

#83 - Firehose: Bulk updates are not functional

Issue - State: open - Opened by NiminU about 1 year ago - 1 comment

#82 - Caused by: java.lang.ClassNotFoundException: com.google.common.util.concurrent.FutureCallback

Issue - State: open - Opened by edha84564 over 1 year ago - 2 comments

#81 - All messages ends up in same shard in Kinesis

Issue - State: open - Opened by nenne70 over 1 year ago

#80 - Create connector in MSK Connect

Issue - State: closed - Opened by nenne70 over 1 year ago - 1 comment

#78 - ISSUE-77 Bump dependecy verions to resolve vulnerabilities

Pull Request - State: closed - Opened by ioanalex almost 2 years ago - 2 comments

#77 - CVEs reported on kinesis-kafka-connector

Issue - State: closed - Opened by nityavyas almost 2 years ago - 8 comments

#76 - Is it possible to read Avro data from MSK, and output it as JSON data to Kinesis?

Issue - State: closed - Opened by synchronizing almost 2 years ago - 2 comments
Labels: help wanted, question

#75 - ISSUE-74 updating junits

Pull Request - State: closed - Opened by bdesert almost 2 years ago

#74 - ISSUE 74 - Build JAR in a standard way

Issue - State: closed - Opened by bdesert almost 2 years ago

#73 - Is it possible to change the format of the data being sinked to kinesis?

Issue - State: open - Opened by miguellgramacho96 almost 2 years ago - 1 comment

#72 - [support]collect data from amazon msk to firehose

Issue - State: open - Opened by tingxin about 2 years ago - 2 comments

#71 - Invalid schema type when sending Avro message containing array of struct to Kinesis

Issue - State: open - Opened by filpano over 2 years ago - 2 comments
Labels: enhancement

#70 - Memory Leak Issue for Kinesis Data Stream Sink Connector.

Issue - State: open - Opened by shanhq96 over 2 years ago

#69 - Caused by: org.apache.kafka.connect.runtime.rest.errors.BadRequestException: Connector config {internal.key.converter=org.apache.kafka.connect.json.JsonConverter, key.converter.schemas.enable=true, offset.storage.file.filename=offset.log, internal.value.converter.schemas.enable=true, internal.value.converter=org.apache.kafka.connect.json.JsonConverter, value.converter.schemas.enable=true, bootstrap.servers=127.0.0.1:9092, value.converter=org.apache.kafka.connect.storage.StringConverter, internal.key.converter.schemas.enable=true, key.converter=org.apache.kafka.connect.storage.StringConverter, schemas.enable=false} contains no connector type

Issue - State: closed - Opened by kapjoshi-cisco over 2 years ago - 1 comment

#68 - Dockerize the connector

Issue - State: open - Opened by masaruhoshi almost 3 years ago - 3 comments

#67 - How do i integrate this with the confluent connect container

Issue - State: open - Opened by ecasilla almost 3 years ago - 2 comments

#66 - can't connect to Firehose with VPC Endpoint

Issue - State: open - Opened by hellotherecsy almost 3 years ago

#65 - org.apache.kafka.common.errors.TimeoutException: Timed out waiting to send the call. Call: fetchMetadata

Issue - State: closed - Opened by paulseo0827 almost 3 years ago - 2 comments

#64 - Compatibility with MSK Connect

Issue - State: closed - Opened by RuiPinto93 almost 3 years ago - 14 comments

#63 - org.apache.kafka.connect.errors.ConnectException: Failed to find any class that implements Connector and which name matches com.amazon.kinesis.kafka.AmazonKinesisSinkConnector

Issue - State: open - Opened by mdsufyan96 about 3 years ago - 2 comments

#62 - Update README.md

Pull Request - State: closed - Opened by bdesert about 3 years ago

#61 - Issue 60 vpc endpoint bug

Pull Request - State: closed - Opened by bdesert about 3 years ago

#60 - VPC endpoint not supported

Issue - State: closed - Opened by dressst about 3 years ago

#59 - ISSUE-54 Spelling

Pull Request - State: closed - Opened by bdesert about 3 years ago

#58 - NPE in DataUtility.java line 35

Issue - State: open - Opened by amaysakh about 3 years ago - 2 comments

#57 - ISSUE-56 Fix NPE in DataUtility

Pull Request - State: closed - Opened by bdesert about 3 years ago

#56 - NullPointerException in DataUtility.java

Issue - State: open - Opened by amaysakh about 3 years ago - 2 comments

#55 - java.io.IOException: Could not create tmp dir /tmp/amazon-kinesis-producer-native-binaries at com.amazonaws.services.kinesis.producer.KinesisProducer.extractBinaries(KinesisProducer.java:885)

Issue - State: open - Opened by vidya-sva over 3 years ago - 1 comment

#54 - Spelling Errors

Issue - State: closed - Opened by wildgordo almost 4 years ago

#53 - AmazonKinesisSinkTask.addUserRecord requires schema

Issue - State: open - Opened by desavera almost 4 years ago - 1 comment

#52 - apply pause/unpase fix

Pull Request - State: closed - Opened by joeb-eb almost 4 years ago

#51 - SSL connection to broker

Issue - State: open - Opened by atulrenapurkar almost 4 years ago

#50 - ISSUE-49: Fix propagation of KPL errors caught in FutureCallback.

Pull Request - State: closed - Opened by skidder almost 4 years ago - 3 comments

#49 - Kafka Connect 'DataException' instances are logged and swallowed by Futures

Issue - State: closed - Opened by skidder almost 4 years ago

#48 - Can kinesis-kafka-connector running on Kafka-connect cluster in aws account A write to a kinesis stream that exists in account B?

Issue - State: closed - Opened by rkrk3 about 4 years ago - 1 comment

#47 - BUG: don't close the producer for the out-of-sync partitions

Pull Request - State: open - Opened by zhiyanliu about 4 years ago

#46 - Creat new distributed connector

Issue - State: open - Opened by atulrenapurkar about 4 years ago - 3 comments

#45 - ISSUE-44 Allow a task to run with an IAM role and external-id.

Pull Request - State: closed - Opened by skidder over 4 years ago - 3 comments
Labels: enhancement

#44 - Support IAM AssumeRole with an External ID

Issue - State: closed - Opened by skidder over 4 years ago

#43 - java.lang.NoClassDefFoundError: com/amazonaws/services/kinesisfirehose/model/AmazonKinesisFirehoseException

Issue - State: open - Opened by learner0101 over 4 years ago - 2 comments

#42 - Is this project dead?

Issue - State: closed - Opened by deuscapturus almost 5 years ago - 1 comment
Labels: question

#41 - ISSUE-40 Support for China region

Pull Request - State: open - Opened by JoeShi almost 5 years ago

#40 - Add support for China region

Issue - State: open - Opened by JoeShi almost 5 years ago - 1 comment

#39 - Add kinesis and cloudwatch endpoint to config, allow to disable cert validation

Pull Request - State: open - Opened by aidarko about 5 years ago

#38 - Provide credentials via configuration

Pull Request - State: open - Opened by marcinziolo about 5 years ago

#37 - Upgrade to Kafka 2 and Kinesis 2 versions

Issue - State: open - Opened by bdesert over 5 years ago

#36 - ISSUE-35 - Update configs

Pull Request - State: closed - Opened by bdesert over 5 years ago

#35 - Enhance maven and github config

Issue - State: closed - Opened by bdesert over 5 years ago - 1 comment
Labels: enhancement

#34 - Java fails to convert object to KafkaTopic

Issue - State: closed - Opened by cjbackman over 5 years ago

#33 - adding gitignore

Pull Request - State: closed - Opened by bdesert over 5 years ago

#32 - Add Mac, IDE. Maven related files to .gitignore

Issue - State: closed - Opened by bdesert over 5 years ago
Labels: enhancement

#31 - Fix java.lang.ClassCastException thrown when pausing/resuming consumption

Pull Request - State: closed - Opened by cjbackman over 5 years ago - 4 comments

#30 - Task threw an uncaught and unrecoverable exception/NullPointerException

Issue - State: open - Opened by mbrettschneider over 5 years ago - 4 comments

#29 - Support proxy setting

Issue - State: closed - Opened by ilyasahsan123 almost 6 years ago

#28 - Unable to load AWS credentials from any provider in the chain

Issue - State: open - Opened by SrinivasaDK almost 6 years ago - 2 comments

#27 - Use AmazonKinesisFirehoseClientBuilder

Pull Request - State: closed - Opened by xushiyan about 6 years ago

#26 - Added support for type conversions, e.g. avro to json

Pull Request - State: closed - Opened by brandonl about 6 years ago

#25 - Added Schema less option

Pull Request - State: open - Opened by Pyons about 6 years ago - 2 comments

#24 - Modify connector for crossaccount

Pull Request - State: closed - Opened by h5chauhan about 6 years ago

#23 - Any plans to write Kafka source connector?

Issue - State: open - Opened by nikesh-devaki about 6 years ago - 2 comments

#22 - SinkConnector fails on JSON input with NullPointerException

Issue - State: closed - Opened by Pyons over 6 years ago - 3 comments

#21 - com.google.common.collect.Sets$SetView.iterator() Exception in thread "main" java.lang.NoSuchMethodError:

Issue - State: open - Opened by ajaysamant over 6 years ago - 6 comments

#20 - We have kafka brokers running in Amex, can we use this connector to send to AWS kinesis.

Issue - State: open - Opened by hyginous29 almost 7 years ago - 3 comments

#19 - Add AssumeRole option

Pull Request - State: open - Opened by cbsmith almost 7 years ago

#18 - NoSuchMethodError when running connect-standalone with this plugin

Issue - State: open - Opened by jevonearth almost 7 years ago - 2 comments

#17 - Caused by: org.apache.kafka.connect.errors.ConnectException: Failed to find any class that implements Connector and which name matches com.amazon.kinesis.kafka.AmazonKinesisSinkConnector

Issue - State: open - Opened by smj19 almost 7 years ago - 3 comments

#16 - Unable to build jar: Could not resolve dependencies

Issue - State: closed - Opened by smj19 almost 7 years ago

#15 - Fix typo in README

Pull Request - State: closed - Opened by josephpconley about 7 years ago

#14 - Task fails when reading Avro encoded event from Kakfa Topic

Issue - State: open - Opened by vsaini-loyaltymethods about 7 years ago - 9 comments

#13 - Add travisci/circleci

Issue - State: open - Opened by jessecollier about 7 years ago

#12 - Adding kinesis stream sync improvements

Pull Request - State: closed - Opened by jessecollier about 7 years ago

#11 - How to customize Kafka consumer.properties

Issue - State: closed - Opened by jameyuan about 7 years ago - 1 comment

#10 - Unable to start the connector

Issue - State: closed - Opened by anshulagl about 7 years ago - 3 comments

#9 - Guaranteed Deliver / Avoid Duplicate Records

Issue - State: open - Opened by pradeepcheers about 7 years ago - 5 comments

#8 - SEVERE: RuntimeException while executing runnable com.google.common.util.concurrent.Futures$6@66177362 with executor INSTANCE org.apache.kafka.connect.errors.DataException: Exception during Kinesis put at com.amazon.kinesis.kafka.AmazonKinesisSinkTask$1.onFailure(AmazonKinesisSinkTask.java:60)

Issue - State: closed - Opened by jameyuan about 7 years ago - 1 comment

#7 - Please help: Connecter Error "Pipes did not show up after calling mkfifo"

Issue - State: closed - Opened by guoxun19 about 7 years ago - 1 comment

#6 - connect-standalone error: connector stopped caused by "Unsupported major.minor version"

Issue - State: closed - Opened by guoxun19 about 7 years ago - 5 comments

#5 - updated to kafka connect version 0.11.0.0

Pull Request - State: closed - Opened by adrianfdzm about 7 years ago

#4 - We occured connect-standalone error... plz help me...

Issue - State: closed - Opened by SungHyeon about 7 years ago - 6 comments

GitHub / awslabs/kinesis-kafka-connector issues and pull requests