dotnet/spark issues and pull requests

#1185 - Support Spark3.3

Pull Request - State: open - Opened by SparkSnail 5 days ago

#1184 - [FEATURE REQUEST]:

Issue - State: closed - Opened by SoumyadipYT-OSS 17 days ago - 3 comments
Labels: enhancement

#1183 - Connection refused issue

Issue - State: open - Opened by isbn390 about 1 month ago - 2 comments

#1182 - [BUG]: Job failed using spark-submit with parameters when job runs in Azure databricks.. INIT_SCRIPT_FAILURE (CLIENT_ERROR).

Issue - State: open - Opened by bmorshed 3 months ago - 1 comment
Labels: bug

#1180 - [BUG]: [Spark.NET 3.5.1] Unable to get Charset 'cp65001' for property 'sun.stderr.encoding'

Issue - State: open - Opened by GeorgeS2019 4 months ago - 1 comment
Labels: bug

#1178 - Spark 3.5.3, .NET 8, CoGrouped UDFs, Fixes, Dependencies and Documentation

Pull Request - State: open - Opened by grazy27 5 months ago - 11 comments
Labels: enhancement

#1177 - FV changes

Pull Request - State: open - Opened by mansijain52 6 months ago - 1 comment

#1176 - Experiment

Issue - State: open - Opened by Adlinke 6 months ago

#1171 - [FEATURE REQUEST]: Deprecate and/or evict Microsoft.Data.Analysis from the Microsoft.Spark assembly

Issue - State: open - Opened by dbeavon 8 months ago - 1 comment
Labels: enhancement

#1170 - [FEATURE REQUEST]: .Net 8.0 support

Issue - State: open - Opened by dbeavon 8 months ago
Labels: enhancement

#1169 - [FEATURE REQUEST]: Stop targeting .net standard (both 2.0 and 2.1)

Issue - State: open - Opened by dbeavon 8 months ago
Labels: enhancement

#1168 - Core 8 first test 04/16

Pull Request - State: closed - Opened by dbeavon 8 months ago - 1 comment

#1167 - [FEATURE REQUEST]: Replacement for BinaryFormatter

Issue - State: closed - Opened by GeorgeS2019 8 months ago - 1 comment
Labels: enhancement

#1166 - Replace BinaryFormatter with MessagePack serialization

Pull Request - State: open - Opened by arsdragonfly 8 months ago - 16 comments

#1165 - I am facing the following issue: The system cannot find the path specified but my pyspark opens up.

Issue - State: closed - Opened by saumyatiwari03 9 months ago - 4 comments

#1164 - [BUG]:

Issue - State: open - Opened by johnstaveley 11 months ago - 11 comments
Labels: bug

#1163 - Raising PR to add support for spark version 3.3

Pull Request - State: open - Opened by vd55338 about 1 year ago - 1 comment

#1162 - Can we breathe life back into this project?

Issue - State: open - Opened by GoEddie about 1 year ago - 23 comments

#1161 - [FEATURE REQUEST]: Spark version 3.1.3 is not supported by current dotnet on spark code. This is preventing Migration to HDI 5.0 which uses spark version 3.1.3

Issue - State: open - Opened by aadithya0701 about 1 year ago - 1 comment
Labels: enhancement

#1159 - [BUG]: Failed to execute 'collectToPython' on 'org.apache.spark.sql.Dataset' with args=()

Issue - State: open - Opened by Ling-Andrew over 1 year ago
Labels: bug

#1158 - support Apache Spark 3.4

Issue - State: open - Opened by Ponyo1234 over 1 year ago - 4 comments
Labels: enhancement

#1157 - Removing deprecated tasks

Pull Request - State: open - Opened by missymessa over 1 year ago

#1156 - Question: How to use DataFrame API to achieve the function equivalent to map/reduce in spark.net

Issue - State: open - Opened by JunweiSUN over 1 year ago

#1155 - [BUG]: When collected, long values are cast to int

Issue - State: open - Opened by aesteve over 1 year ago
Labels: bug

#1154 - Update maven link again

Pull Request - State: open - Opened by dragorosson over 1 year ago

#1151 - [FEATURE REQUEST]: Status of Project

Issue - State: open - Opened by mmihalikcs over 1 year ago - 1 comment
Labels: enhancement

#1150 - 3.3 and 3.4 support initially added

Pull Request - State: open - Opened by msaltan over 1 year ago - 2 comments

#1149 - [FEATURE REQUEST]: .Net 6.0/7.0 Support

Issue - State: open - Opened by Vislesha over 1 year ago - 24 comments
Labels: enhancement

#1148 - [BUG]:

Issue - State: open - Opened by varanasitarun over 1 year ago - 1 comment
Labels: bug

#1147 - [FEATURE REQUEST]: Benchmark Spark.NET versus PySpark and SparkR

Issue - State: open - Opened by GeorgeS2019 over 1 year ago
Labels: enhancement

#1147 - [FEATURE REQUEST]: Benchmark Spark.NET versus PySpark and SparkR

Issue - State: open - Opened by GeorgeS2019 over 1 year ago
Labels: enhancement

#1147 - [FEATURE REQUEST]: Benchmark Spark.NET versus PySpark and SparkR

Issue - State: open - Opened by GeorgeS2019 over 1 year ago
Labels: enhancement

#1147 - [FEATURE REQUEST]: Benchmark Spark.NET versus PySpark and SparkR

Issue - State: open - Opened by GeorgeS2019 over 1 year ago
Labels: enhancement

#1146 - [BUG]: Hive incompatibility when using microsoft-spark-3-1_2.12-2.1.1.jar

Issue - State: open - Opened by dcosta91 over 1 year ago - 1 comment
Labels: bug

#1146 - [BUG]: Hive incompatibility when using microsoft-spark-3-1_2.12-2.1.1.jar

Issue - State: open - Opened by dcosta91 over 1 year ago - 1 comment
Labels: bug

#1146 - [BUG]: Hive incompatibility when using microsoft-spark-3-1_2.12-2.1.1.jar

Issue - State: open - Opened by dcosta91 over 1 year ago - 1 comment
Labels: bug

#1146 - [BUG]: Hive incompatibility when using microsoft-spark-3-1_2.12-2.1.1.jar

Issue - State: open - Opened by dcosta91 over 1 year ago - 1 comment
Labels: bug

#1145 - Support for NotebookUtils

Issue - State: open - Opened by mzivtins over 1 year ago

#1142 - Can't a .netcore program connect to a remote spark cluster? If so, what should I do? please help me

Issue - State: open - Opened by Ponyo1234 almost 2 years ago
Labels: enhancement

#1142 - Can't a .netcore program connect to a remote spark cluster? If so, what should I do? please help me

Issue - State: open - Opened by Ponyo1234 almost 2 years ago
Labels: enhancement

#1142 - Can't a .netcore program connect to a remote spark cluster? If so, what should I do? please help me

Issue - State: open - Opened by Ponyo1234 almost 2 years ago
Labels: enhancement

#1141 - If you are a webapi project, you also need to use spark-submit? Is there a webapi example to refer to

Issue - State: closed - Opened by Ponyo1234 almost 2 years ago
Labels: enhancement

#1141 - If you are a webapi project, you also need to use spark-submit? Is there a webapi example to refer to

Issue - State: closed - Opened by Ponyo1234 almost 2 years ago
Labels: enhancement

#1141 - If you are a webapi project, you also need to use spark-submit? Is there a webapi example to refer to

Issue - State: closed - Opened by Ponyo1234 almost 2 years ago
Labels: enhancement

#1140 - 如果是web api项目也需要用spark-submit嘛

Issue - State: closed - Opened by Ponyo1234 almost 2 years ago
Labels: enhancement

#1140 - 如果是web api项目也需要用spark-submit嘛

Issue - State: closed - Opened by Ponyo1234 almost 2 years ago
Labels: enhancement

#1139 - .NET for Apache Spark v2.1.2 in .NET7 ?

Issue - State: open - Opened by GeorgeS2019 almost 2 years ago - 20 comments
Labels: bug

#1139 - .NET for Apache Spark v2.1.2 in .NET7 ?

Issue - State: open - Opened by GeorgeS2019 almost 2 years ago - 19 comments
Labels: bug

#1137 - Error from many DataFrame methods after UDF called in DataFrame.WithColumn

Issue - State: open - Opened by dogulas-accip almost 2 years ago - 1 comment
Labels: bug

#1136 - Question: can I use the spark extension to read a delta table?

Issue - State: open - Opened by funkysandman almost 2 years ago - 2 comments

#1136 - Question: can I use the spark extension to read a delta table?

Issue - State: open - Opened by funkysandman almost 2 years ago - 2 comments

#1136 - Question: can I use the spark extension to read a delta table?

Issue - State: open - Opened by funkysandman almost 2 years ago - 2 comments

#1135 - Q: How to output to logs?

Issue - State: open - Opened by Krumelur almost 2 years ago

#1135 - Q: How to output to logs?

Issue - State: open - Opened by Krumelur almost 2 years ago

#1135 - Q: How to output to logs?

Issue - State: open - Opened by Krumelur almost 2 years ago

#1134 - Q: How to handle exceptions?

Issue - State: open - Opened by Krumelur almost 2 years ago

#1134 - Q: How to handle exceptions?

Issue - State: open - Opened by Krumelur almost 2 years ago

#1132 - Wait before running apt command

Pull Request - State: closed - Opened by ericstj almost 2 years ago - 5 comments

#1132 - Wait before running apt command

Pull Request - State: closed - Opened by ericstj almost 2 years ago - 5 comments

#1132 - Wait before running apt command

Pull Request - State: closed - Opened by ericstj almost 2 years ago - 5 comments

#1131 - JVM IPC Deserialization uses BinaryFormatter, which is now Deprecated for OWASP CWE

Issue - State: open - Opened by cutecycle almost 2 years ago - 1 comment
Labels: bug