|
所在平台: Udemy |
课程主页: https://www.udemy.com/course/5-h-data-challenge-course-scraping-cleaning-analysis/
课程评论：没有评论
课程名称：5 H 数据挑战课程 - 抓取、清洗与分析 课程概述：本课程将涵盖三个主要主题：1）数据提取/网页抓取，2）数据清洗，3）数据分析。我们将从10个不同城市/州获取房地产数据，收集完所有必要的数据后，将多个数据集合并为一个数据集。接下来，我们将使用Pandas库进行清洗，目的是使数据可读，并能够修改/操作数据。清洗完数据后，我们将进行数据分析，回答基于提取和清洗后数据集的10个问题。为了解答这些问题，我们将使用Pandas DataFrame、PostgreSQL和Matplotlib。你将了解如何基于自己创建的数据集回答现实生活中的问题。 完成本课程后，你将具备抓取自己数据的知识与经验，并能创建自己的数据集。在数据集创建完成后，我们将进行数据清洗，最后专注于数据分析。课程资源将为你提供参考文档，如果有任何问题，或某个概念不明白，你可以随时在问答论坛内提问，授课教师或其他学生会为你解答。得益于这个社区，你不会感到自己是孤单学习的。 你将学到的内容包括： - 网页抓取 - Pandas - Beautiful Soup - 数据提取 - 数据科学中的网页抓取 - 数据挖掘 - 数据抓取与清洗 - 数据分析 - PostgreSQL 课程要求：对Python编程和Beautiful Soup有基本的理解。 适合对象：对网页抓取（创建自己的数据集）、数据清洗和数据分析感兴趣的所有人，以及希望独立创建数据集的专业人士。 免责声明：我教授网页抓取仅用于教育目的。抓取网页的第一条规则是：不伤害特定网站。网页爬虫的第二条规则是：不伤害特定网站。
3 Main Topics will be covered: 1) Data Extraction/ Web Scraping2) Data Cleaning3) Data AnalysisWe start with the extraction of Real Estate Data from 10 different cities/states. Once we have collected all the necessary data, the datasets will be merged to one dataset. Then the cleaning process with the Pandas Library will start. The goal is to make the data database readable and modifying/ manipulating the data. Once our data is cleaned, we start with the Data Analysis part. That means we will answer 10 different questions, based on our extracted and cleaned dataset. To be able to answer the 10 questions, we make use of the Pandas Dataframe, PostgreSQL and Matplotlib. You will get to know different approaches to how answer real life questions based your own created dataset.After this course you will have the knowledge and the experience to scrape your own data and create your own dataset. After the datasets is created, we will clean the data and finally focus on the data analysis. With the help of the course resources you will always have documents you can refer to. If you have a question or if a concept just does not make sense to you, you can ask your questions anytime inside the Q & A - Forum. Either the instructor or other students will answer your question. Thanks to the community you will never have the feeling to learn alone by yourself.What you'll learnWeb ScrapingPandasBeautiful SoupData ExtractionWeb Scraping for Data ScienceData MiningData Scraping & Data CleaningData AnalysisPostgreSQLAre there any course requirements or prerequisites?Basic understanding of Python ProgrammingBasic understanding of Beautiful SoupWho this course is for:Everybody who is interested in Web Scraping (Create own dataset), Data Cleaning & Data AnalysisProfessionals who want to create their own dataset without being dependent on some elseDisclaimer: I teach web scraping as a tutor for educational purposes. That's it. The first rule of scraping the web is: do not harm a certain website. The second rule of web crawling is: do NOT harm a certain website.
