paint-brush
A Guide to Extracting All Links on a Website Using Pythonby@kalebujordan
3,073 reads
3,073 reads

A Guide to Extracting All Links on a Website Using Python

by Kalebu Jordan 1mOctober 26th, 2020
Read on Terminal Reader
Read this story w/o Javascript
tldt arrow

Too Long; Didn't Read

A Guide to Extracting All Links on a Website Using Python using Python's BeautifulSoup and requests. We will use the requests library to get the raw HTML page from the website and then Beautiful Soup to extract all the links from the HTML. The code below is a code that will prompt you to enter a link to a website. It will use requests to send a GET request to the server to request the HTML page and then use BeautifulSoups to extract the links. The original article can be found on kalebujordan.com/learn-how-to-extract-all-links.

Companies Mentioned

Mention Thumbnail
Mention Thumbnail
featured image - A Guide to Extracting All Links on a Website Using Python
Kalebu Jordan  HackerNoon profile picture
Kalebu Jordan

Kalebu Jordan

@kalebujordan

I'm a Mechatronics engineer | Pro Python Developer | AI Enthusiast

Learn More
LEARN MORE ABOUT @KALEBUJORDAN'S
EXPERTISE AND PLACE ON THE INTERNET.
L O A D I N G
. . . comments & more!

About Author

Kalebu Jordan  HackerNoon profile picture
Kalebu Jordan @kalebujordan
I'm a Mechatronics engineer | Pro Python Developer | AI Enthusiast

TOPICS

THIS ARTICLE WAS FEATURED IN...

Permanent on Arweave
Read on Terminal Reader
Read this story in a terminal
 Terminal
Read this story w/o Javascript
Read this story w/o Javascript
 Lite