|
所在平台: Udemy |
课程主页: https://www.udemy.com/course/webscraping-using-api-beautiful-soup-and-pandas/
课程评论:没有评论
课程名称:使用Python进行网页抓取、API、Beautiful Soup和Pandas 课程概述:本课程旨在帮助您使用Python API和Beautiful Soup抓取您的第一个网页,并使用Pandas结构化数据。 在API部分中,您将学习API的工作原理以及如何使用Python实现它。您将学会如何使用API发送获取和发布请求,并实现相关功能。课程中将创建一个简单的货币转换计算器,使用JSON进行数据处理。此外,还会介绍需要登录的网站的API,我们将使用API密钥和ID进行登录并提取详细信息。最后,将讲解如何使用Pandas将数据结构化并导出为CSV格式。 在网页抓取部分,您将学习如何抓取数据并将其存储为所需格式。您将实践数据抓取和解析,并将数据存储在Pandas中以便查阅。课程将帮助您理解HTML和JavaScript文件的结构,以便能够解析数据。还将进行两个项目,进行数据抓取并根据自己的需求进行解析。 Beautiful Soup是一个易于学习和掌握的库,例如,如果我们想提取网页上的所有链接,它非常方便。它拥有良好的文档,可以帮助我们快速学习,同时也有良好的社区支持,可以解决在使用该库时遇到的问题。 课程大纲:无
Scrape your first web page using Python API ,Beautiful soup and structure the data using PandasAPI Python:This section help you understand the working on API and how to implement the same using Python.Here we will learn how to get and post the request using API and implement the same.Will create a simple currency conversion calculator using JSON.We will also cover API for website which we need to sign in. We will be using the API keys and ID to login and fetch the details.We will explain how to structure and export the data in CSV using Pandas.Web Scraping:This Section helps you to learn Scraping the data and storing the data in our desired Format.Here we will have the data scraped and use parsing of data and store it in Pandas for reference.Helps in Understanding the structure of HTML and Javascript file to parse the data.2 Projects to Scrape the data and parse them as our wish.Beautiful Soup:It is easy to learn and master. for example, if we want to extract all the links from the webpageIt has good comprehensive documentation which helps us to learn the things quickly.It has good community support to figure out the issues that arise while we are working with this library.