Pyspark join Multiple dataframes

Overview PySpark is a good python library to perform large-scale exploratory data analysis, create machine learning pipelines and create ETLs for a data platform. If you already have an intermediate level in Python and libraries such as Pandas, then PySpark is an excellent language to learn to create more scalable and relevant analyses and pipelines.… Continue reading Pyspark join Multiple dataframes

Pandas drop column

Pandas drop column : If you work in data science and python, you should be familiar with the python pandas library; Pandas development started in 2008 with lead developer Wes McKinney and the library has become a standard for data analysis and management using Python. Mastering the pandas library is essential for professionals working in… Continue reading Pandas drop column

Categorized as Python

Python pandas read_csv

Python pandas read_csv : Pandas read_csv() method is used to read CSV file (Comma-separated value) into DataFrame object. The CSV format is an open text format representing tabular data as comma-separated values. Pandas module is a fast, powerful, flexible and easy to use open source data analysis and manipulation tool, built on top of the Python programming language.… Continue reading Python pandas read_csv

Categorized as Python

Pandas get column names

Pandas get column names : When analyzing large datasets, it may be necessary to obtain column names to perform certain operations on the dataset. In this article, I will show you four ways to retrieve column names in a Pandas dataframe. Let’s start by creating a relatively simple dataset. Now let’s try to get the… Continue reading Pandas get column names

Jupyter notebook windows

Today we will see how to install jupyter notebook to use python on a windows computer. Jupyter notebooks are electronic notebooks that can gather text, images, mathematical formulas and executable computer code. They can be manipulated interactively in a web browser. Developed for the languages Julia, Python and R (hence the name JUPYTER), it is… Continue reading Jupyter notebook windows