SparkHow to write single CSV file using spark?Apache Spark by default writes CSV file output in multiple parts-*.CSV, inside a directory. Reason is simple it creates multiple files...
SparkHow to convert RDD to Dataframe?Main menu: Spark Scala Tutorial There are basically three methods by which we can convert a RDD into Dataframe. I am using spark shell to...
Big DataWhat's Artificial Intelligence, Machine Learning, Deep Learning, Predictive Analytics, Data Science?Never thought I will spend so much time to understand these high profile terms. I was very confident that I knew theoretically everything...
SparkSpark read Text file into DataframeMain menu: Spark Scala Tutorial In this Spark Scala tutorial you will learn how to read data from a text file & CSV to dataframe. This...
SparkStreamingContext: Spark streaming word count example ScalaMain menu: Spark Scala Tutorial In this tutorial you will learn, How to stream data in real time using Spark streaming? Spark streaming...