Apache Spark™ community

Have questions?

StackOverflow

For usage questions and help (e.g. how to use this Spark API), it is recommended you use the StackOverflow tag apache-spark as it is an active forum for Spark users’ questions and answers.

Some quick tips when using StackOverflow:

• Prior to asking submitting questions, please:
  • Search StackOverflow’s apache-spark tag to see if your question has already been answered
  • Search the ASF archive for user@spark.apache.org
• Please follow the StackOverflow code of conduct
• Always use the apache-spark tag when asking questions
• Please also use a secondary tag to specify components so subject matter experts can more easily find them. Examples include: pyspark, spark-dataframe, spark-streaming, spark-r, spark-mllib, spark-ml, spark-graphx, spark-graphframes, spark-tensorframes, etc.
• Please do not cross-post between StackOverflow and the mailing lists
• No jobs, sales, or solicitation is permitted on StackOverflow

Mailing lists

For broad, opinion based, ask for external resources, debug issues, bugs, contributing to the project, and scenarios, it is recommended you use the user@spark.apache.org mailing list.

• user@spark.apache.org is for usage questions, help, and announcements. (subscribe) (unsubscribe) (archives)
• dev@spark.apache.org is for people who want to contribute code to Spark. (subscribe) (unsubscribe) (archives)

Some quick tips when using email:

• Prior to asking submitting questions, please:
  • Search StackOverflow at apache-spark to see if your question has already been answered
  • Search the ASF archive for user@spark.apache.org
• Tagging the subject line of your email will help you get a faster response, e.g. [Spark SQL]: Does Spark SQL support LEFT SEMI JOIN?
• Tags may help identify a topic by:
  • Component: Spark Core, Spark SQL, ML, MLlib, GraphFrames, GraphX, TensorFrames, etc
  • Level: Beginner, Intermediate, Advanced
  • Scenario: Debug, How-to
• For error logs or long code examples, please use GitHub gist and include only a few lines of the pertinent code / log within the email.
• No jobs, sales, or solicitation is permitted on the Apache Spark mailing lists.

Reporting security issues

Please see the Security page for information on how to report sensitive security vulnerabilities, and for information on known security issues.

Chat rooms

Chat rooms are great for quick questions or discussions on specialized topics. The following chat rooms are not officially part of Apache Spark; they are provided for reference only.

• Spark with Scala is for questions and discussions related to using Spark with the Scala programming language.

Events and meetups

Conferences

• Spark Summit Europe 2017. Oct 24 - 26 in Dublin.
• Spark Summit 2017. June 5 - 7 in San Francisco.
• Spark Summit Europe 2016. Oct 25 - 27 in Brussels.
• Spark Summit 2016. June 6 - 8 in San Francisco.
• Spark Summit East 2016. Feb 16 - 18 in New York City.
• Spark Summit Europe 2015. Oct 27 - 29 in Amsterdam.
• Spark Summit 2015. June 15 - 17 in San Francisco.
• Spark Summit East 2015. March 18 - 19 in New York City.
• Spark Summit 2014. June 30 - July 1 2014 in San Francisco.
• Spark Summit 2013. December 2013 in San Francisco.

Meetups

Spark Meetups are grass-roots events organized and hosted by individuals in the community around the world. Check out meetup.com/topics/apache-spark to find a Spark meetup in your part of the world. Below is a partial list of Spark meetups.

• Bay Area Spark Meetup. This group has been running since January 2012 in the San Francisco area. The meetup page also contains an archive of past meetups, including videos and slides for most of the recent talks.
• Barcelona Spark Meetup
• Bangalore Spark Meetup
• Bogotá Spark Meetup
• Boston Spark Meetup
• Boulder/Denver Spark Meetup
• Christchurch Apache Spark Meetup
• Hangzhou Spark Meetup
• Israel Spark Users
• Ljubljana Spark Meetup
• London Spark Meetup
• Maryland Spark Meetup
• México City Spark Meetup
• Moscow Spark Meetup
• Mumbai Spark Meetup
• NYC Spark Meetup
• Seattle Spark Meetup
• Shanghai Spark Meetup
• Shenzhen Spark Meetup
• Tokyo Spark Meetup
• Vancouver Spark Meetup
• Washington DC Area Spark Meetup

If you'd like your meetup or conference added, please email user@spark.apache.org.

Issue tracker

The project tracks bugs and new features on JIRA. If you'd like, you can also subscribe to issues@spark.apache.org to receive emails about new issues, and commits@spark.apache.org to get emails about commits.

Shop

The ASF has an official store at RedBubble that Apache Community Development (ComDev) runs. In the store, various products featuring the Apache Spark logo are available.

Powered by

Our site has a list of projects and organizations powered by Spark. Add yours by emailing `dev@spark.apache.org`.