Pyspark dataframe basics
Spark is very popular among data engineering professionals and companies working with large scaled data. Spark enables us to process large volumes of data with ease in a clusted (Distributed) environment.
Pytest
pytest is a testing framework for the python programming language. Based on the official documentation - pytest makes it easy to write small tests, yet scales to support complex functional testing for applications and libraries.
Robot Framework Setup
Once robot framework is installed, you are all set to automate your redundant office tasks. I will cover the basic demo in the upcoming posts.
Data Engineer | Photographer | Traveller
I am a data engineer with more than 7 years of experience in the software industry. I started my career as a system analyst (QA automation) and eventually switched to software development. I am a wildlife photographer with keen interest in wildlife conservation and research.
Learn More