I have created this blog to share my experience on Data Engineering using technology PySpark, Hive, SQL.
This blogs gives you the detailed solution with Input/Output data. I genearlly used Sample data and try to reshape those and bring the insights from the data.
PySpark dataframes can run on parallel architectures and even support SQL queries's.
SQL stands for Structured Query Language. SQL is used to communicate with a database's.
The Apache Hive ™ data warehouse software facilitates reading, writing, and managing large datasets residing in distributed storage using SQL's.
Python is a general-purpose interpreted, interactive, object-oriented, and high-level programming language's.
