前 言
第1章　交通大數(shù)據(jù)概述........................................1
1.1　大數(shù)據(jù)概述.......................................................................................3
1.2　大數(shù)據(jù)處理過程................................................................................5
1.3　交通大數(shù)據(jù)的來源............................................................................7
1.4　交通大數(shù)據(jù)的應用............................................................................9
1.5　交通大數(shù)據(jù)發(fā)展面臨的挑戰(zhàn).............................................................10
1.6　思考練習........................................................................................11
第2章　某市出租車項目實戰(zhàn)案例部署.....................13
2.1　項目背景........................................................................................15
2.2　主要流程........................................................................................15
2.3　項目難點分析.................................................................................16
2.4　數(shù)據(jù)加載........................................................................................16
2.5　本地開發(fā)環(huán)境搭建..........................................................................20
2.6　發(fā)布Tomcat可視化頁面.................................................................31
2.7　數(shù)據(jù)可視化效果展示.......................................................................34
2.8　思考練習........................................................................................44
第3章　某市出租車項目設計................................45
3.1　數(shù)據(jù)源...........................................................................................47
3.2　項目整體架構設計..........................................................................48
3.3　選擇所需軟件.................................................................................49
3.4　Hadoop集群規(guī)劃...........................................................................49
3.5　大數(shù)據(jù)ETL過程..............................................................................50
3.6　思考練習........................................................................................53
第4章　Python語言基礎...................................55
4.1　Python語言概述............................................................................57
4.2　PyCharm概述...............................................................................58
4.3　Python基礎...................................................................................64
4.4　思考練習........................................................................................72
第5章 數(shù)據(jù)提取...............................................73
5.1　數(shù)據(jù)爬蟲........................................................................................75
5.2　文件數(shù)據(jù)提取.................................................................................86
5.3　思考練習........................................................................................93
第6章　數(shù)據(jù)清洗..............................................95
6.1　數(shù)據(jù)清洗過濾.................................................................................97
6.2　各類格式文件的數(shù)據(jù)輸出..............................................................105
6.3　思考練習......................................................................................110
第7章 數(shù)據(jù)存儲..............................................111
7.1　HDFS加載存儲............................................................................113
7.2　Sqoop加載存儲...........................................................................116
7.3　思考練習......................................................................................120
第8章　數(shù)據(jù)分析處理.......................................121
8.1　MapReduce概述.........................................................................123
8.2　MapReduce體系結構..................................................................125
8.3　MapReduce工作流程..................................................................125
8.4　MapReduce開發(fā)環(huán)境配置...........................................................127
8.5　統(tǒng)計求和......................................................................................139
8.6　全排序.........................................................................................147
8.7　二次排序......................................................................................150
8.8　最值.............................................................................................156
8.9　連接.............................................................................................160
8.10　思考練習....................................................................................163
第9章 ECharts的應用...................................165
9.1　ECharts的基本概念.....................................................................167
9.2　ECharts快速上手........................................................................170
9.3　思考練習......................................................................................190
第10章　某市出租車項目綜合編程實踐.................193
10.1　項目整體需求分析......................................................................195
10.2　項目架構....................................................................................196
10.3　數(shù)據(jù)Extract—— 提取格式轉換....................................................197
10.4　數(shù)據(jù)Transform—— 數(shù)據(jù)過濾.....................................................198
10.5　數(shù)據(jù)Transform—— 補充空數(shù)據(jù)..................................................201
10.6　數(shù)據(jù)Load—— 文件HDFS存儲....................................................203
10.7　數(shù)據(jù)Transform—— MapReduce...............................................204
10.8　數(shù)據(jù)Load—— Sqoop導出數(shù)據(jù)...................................................218
10.9　數(shù)據(jù)可視化................................................................................220
10.10　思考練習..................................................................................229
參考文獻......................................................230