|
所在平台: Udemy |
课程主页: https://www.udemy.com/course/web-scraping-with-python-beautifulsoup/
课程评论：没有评论
课程名称：使用Python进行网页抓取：BeautifulSoup、Requests与Selenium 课程概述：网页抓取（也称为屏幕抓取、网页数据提取、网页采集等）是一种从网站提取大量数据并将其保存到本地文件或数据库的技术。在本课程中，您将学习如何使用Python 3及Beautiful Soup库进行网页抓取。Beautiful Soup是一个免费的开源库，用于解析HTML文档。课程中还将使用lxml库，它是一个快速解析XML和HTML文件的强大库，能够处理不规范的标签。此外，我们将使用Requests模块来代替内置的urllib2模块，因为其在速度和可读性方面有了显著提升。最后，我们还将利用Selenium与Beautiful Soup结合，抓取基于AJAX和JavaScript驱动的页面。 课程内容包括：以编程方式访问网页；使用Beautiful Soup解析网页以提取所需数据；以编程方式与网页互动；在需要时使用Selenium进行网页抓取。课程结束时，您将理解网站和服务器的运作方式，掌握多种数据提取技术，以及数据处理和组织的方法。 课程重点包括： - 数据结构回顾（列表、字典、元组、文件处理） - 网站如何在服务器上托管 - 服务器调用（GET、POST方法） - HTML和CSS回顾 - Requests模块和BeautifulSoup模块概述 - 使用BeautifulSoup解析HTML - 使用BeautifulSoup过滤元素和导航解析树 - JavaScript和AJAX概述 - Selenium及其必要性 - 使用Selenium选择元素的CSS选择器和XPath选择器 - 使用Selenium导航页面 - 实际项目 本课程适合对网页抓取和数据处理感兴趣的学习者。
Web Scraping (also termed Screen Scraping, Web Data Extraction, Web Harvesting, etc.) is a technique for extracting large amounts of data from websites and save the the extracted data to a local file or to a database. In this course, you will learn how to perform web scraping using Python 3 and the Beautiful Soup, a free open-source library written in Python for parsing HTML. We will use lxml, which is an extensive library for parsing XML and HTML documents very quickly; it can even handle messed up tags. We will also be using the Requests module instead of the already built-in urllib2 module due to improvements in speed and readability. Finally, we will use Selenium alongside Beautiful Soup to crawl AJAX & JavaScript driven pages. The course cover the following topics: accessing web pages programmatically; scraping web pages to extract the required data using Beautiful Soup to parse web pages; interacting with web pages to do different things with them programmatically; and using Selenium for web scraping and when we need it. By the end of this course, you will be able to understand how websites and servers function, diverse data extraction techniques, and methods of handling and organizing data. This Web Scraping course covers the following topics: Review of data structures (Lists, Dictionaries, Tuples, File Handling)How websites are hosted on serversCalls to the server (GET, POST methods)Review of HTML and CSSRequests Module and BeautifulSoup Module overviewParsing HTML using BeautifulSoupFiltering elements using BeautifulSoup and navigating the Parse TreeJavaScript and AJAX overviewSelenium and the need for itSelecting elements using Selenium CSS selectors XPath selectors Navigating pages using Selenium Practical Projects
