The Wayback Machine - https://web.archive.org/web/20220530035705/https://github.com/topics/spark-sql
Skip to content
#

spark-sql

Here are 537 public repositories matching this topic...

carlbrochu
carlbrochu commented Apr 18, 2019

Is your feature request related to a problem? Please describe.
Today the user needs to deploy udf jars and reference data csvs manually to the blob location

Describe the solution you'd like
Enable the user to choose a file on a local disk which the web portal will then upload to the right location

enhancement help wanted good first issue

A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL
  • Updated Feb 1, 2019
  • TypeScript
qbeast-spark
osopardo1
osopardo1 commented Mar 7, 2022

When writing data with qbeast format, the user needs to specify every time the columnsToIndex or cubeSize. This is ok if you want to change them, but it shouldn't be always explicit.

For example, if the user wants to append data to an existing table and maintain the same configuration, it should be able to write:

df.write.format("qbeast").save("existing-path")

instead

enhancement good first issue
GongchuangSu
GongchuangSu commented Jan 21, 2022

版本信息

  • dt-sql-parser版本:4.0.0-beta.2.2
  • tsc版本:4.5.4
$ tsc -v
Version 4.5.4

报错信息

执行npx tsc,报错如下:

node_modules/dt-sql-parser/dist/lib/flinksql/FlinkSqlParserListener.d.ts:4:16 - error TS1005: '(' expected.

4     constructor: typeof FlinkSqlParserListener;
                 ~

node_modules/dt-sql-parser/dist/lib/flinksql/FlinkSqlParserVisitor.d.ts:4:16 - e
good first issue

Apache Spark is a fast, in-memory data processing engine with elegant and expressive development API's to allow data workers to efficiently execute streaming, machine learning or SQL workloads that require fast iterative access to datasets.This project will have sample programs for Spark in Scala language .
  • Updated Jan 19, 2022
  • Scala

Improve this page

Add a description, image, and links to the spark-sql topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the spark-sql topic, visit your repo's landing page and select "manage topics."

Learn more