Pyspark Structured APIs - Dataframes

Pyspark dataframe basics

Vasav

6 minute read

Spark is very popular among data engineering professionals and companies working with large scaled data. Spark enables us to process large volumes of data with ease in a clusted (Distributed) environment.

AWS Cli Setup on Macbook with M1 chipset

AWS Cli Setup

Vasav

1 minute read

usage: aws [options] <command> <subcommand> [<subcommand> ...] [parameters]
To see help text, you can run:

  aws help
  aws <command> help
  aws <command> <subcommand> help

aws: error: the following arguments are required: command

This suggests successful installation of AWS CLI.