apache-spark

Apache Spark is an open source distributed general-purpose cluster-computing framework. It provides an interface for programming entire clusters with implicit data parallelism and fault tolerance.
Here are 1,232 public repositories matching this topic...
-
Updated
May 18, 2022 - Scala
I have a simple regression task (using a LightGBMRegressor) where I want to penalize negative predictions more than positive ones. Is there a way to achieve this with the default regression LightGBM objectives (see https://lightgbm.readthedocs.io/en/latest/Parameters.html)? If not, is it somehow possible to define (many example for default LightGBM model) and pass a custom regression objective?
-
Updated
Oct 19, 2021 - JavaScript
-
Updated
Jun 1, 2022 - Jupyter Notebook
Git supports dated revisions:
[<refname>]@{<date>}, e.g. master@{yesterday}, HEAD@{5 minutes ago}
A ref followed by the suffix @ with a date specification enclosed in a brace pair
(e.g. {yesterday}, {1 month 2 weeks 3 days 1 hour 1 second ago} or
{1979-02-26 18:30:00}) specifies the value of the ref at a prior point in time.
This suffix may only be u
-
Updated
Jun 2, 2022 - Go
-
Updated
Aug 16, 2021 - Java
Describe the bug
When the finalizer is called for CLR JvmObjectId objects, it calls the rm
DotnetBackend method and this calls goes through the JvmBridge
class. Because the rm
call goes through [JvmBridge.CallJavaMethod](https://github.com/do
-
Updated
Dec 27, 2021 - Shell
-
Updated
Mar 15, 2022 - Shell
-
Updated
Dec 31, 2020 - Python
-
Updated
Dec 3, 2019 - Python
-
Updated
Mar 9, 2020 - Python
-
Updated
Jan 29, 2021 - C#
-
Updated
Jun 1, 2022 - R
-
Updated
Mar 22, 2022 - Scala
-
Updated
Dec 12, 2021 - Scala
-
Updated
Feb 12, 2022
-
Updated
Jul 25, 2018 - Python
-
Updated
Jan 8, 2020 - Scala
-
Updated
May 13, 2022 - Python
-
Updated
Feb 23, 2022 - Java
-
Updated
Dec 21, 2021
-
Updated
Apr 27, 2022 - Scala
-
Updated
Oct 29, 2021 - Jupyter Notebook
-
Updated
Apr 5, 2022
-
Updated
Mar 30, 2021 - Python
Created by Matei Zaharia
Released May 26, 2014
- Repository
- apache/spark
- Website
- spark.apache.org
- Wikipedia
- Wikipedia
We use problem matchers to surface python code formatting issues detected by
black
on GitHub UI as shown in the screenshot below:We want to replace `wo