Let’s get back to PySpark
Photo by Maxwell Nelson on Unsplash

As a Data Engineer you might have to switch between different programming/scripting languages after certain period. In my experience I usually need to switch between pure SQL queries, Java, Shell scripting, Scala and Python as per the project requirements.

These immediate transitions may take some time to get us on-board, sometimes we need to look for whether the direct functions are available for that programming language or not along with the syntaxes. …

Brijesh Rana

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store