基于python下的大数据分析(计划篇)
计划用一年的时间学习数据分析的相关知识,以及参加相关竞赛,为以后找工作做铺垫。在这里做笔记,增加自己的印象的同时,对遇到相同问题的小伙伴希望有帮助
个人相关信息
1.目前大三,专业为电子信息工程。 2.学过基础python编程 3.学过基本的概率论及数理统计
个人计划
课时集中在前三天,每周都抽时间学习数据分析类的知识,并完成两篇笔记博客的书写,不定时的更新遇到的问题,以及解决方式。
学习数据分析的原因
1.咱们处于一个网络信息高度发达的21世纪,信息数据非常多,我们可以从这些庞大的数据中,找到有用的信息。 2.现实一点,大数据在目前,尤其是一些大企业需要数据分析师,薪资相当可观。
学习流程
#mermaid-svg-6kafKJCV5bLfZDkF .label{font-family:'trebuchet ms', verdana, arial;font-family:var(--mermaid-font-family);fill:#333;color:#333}#mermaid-svg-6kafKJCV5bLfZDkF .label text{fill:#333}#mermaid-svg-6kafKJCV5bLfZDkF .node rect,#mermaid-svg-6kafKJCV5bLfZDkF .node circle,#mermaid-svg-6kafKJCV5bLfZDkF .node ellipse,#mermaid-svg-6kafKJCV5bLfZDkF .node polygon,#mermaid-svg-6kafKJCV5bLfZDkF .node path{fill:#ECECFF;stroke:#9370db;stroke-width:1px}#mermaid-svg-6kafKJCV5bLfZDkF .node .label{text-align:center;fill:#333}#mermaid-svg-6kafKJCV5bLfZDkF .node.clickable{cursor:pointer}#mermaid-svg-6kafKJCV5bLfZDkF .arrowheadPath{fill:#333}#mermaid-svg-6kafKJCV5bLfZDkF .edgePath .path{stroke:#333;stroke-width:1.5px}#mermaid-svg-6kafKJCV5bLfZDkF .flowchart-link{stroke:#333;fill:none}#mermaid-svg-6kafKJCV5bLfZDkF .edgeLabel{background-color:#e8e8e8;text-align:center}#mermaid-svg-6kafKJCV5bLfZDkF .edgeLabel rect{opacity:0.9}#mermaid-svg-6kafKJCV5bLfZDkF .edgeLabel span{color:#333}#mermaid-svg-6kafKJCV5bLfZDkF .cluster rect{fill:#ffffde;stroke:#aa3;stroke-width:1px}#mermaid-svg-6kafKJCV5bLfZDkF .cluster text{fill:#333}#mermaid-svg-6kafKJCV5bLfZDkF div.mermaidTooltip{position:absolute;text-align:center;max-width:200px;padding:2px;font-family:'trebuchet ms', verdana, arial;font-family:var(--mermaid-font-family);font-size:12px;background:#ffffde;border:1px solid #aa3;border-radius:2px;pointer-events:none;z-index:100}#mermaid-svg-6kafKJCV5bLfZDkF .actor{stroke:#ccf;fill:#ECECFF}#mermaid-svg-6kafKJCV5bLfZDkF text.actor>tspan{fill:#000;stroke:none}#mermaid-svg-6kafKJCV5bLfZDkF .actor-line{stroke:grey}#mermaid-svg-6kafKJCV5bLfZDkF .messageLine0{stroke-width:1.5;stroke-dasharray:none;stroke:#333}#mermaid-svg-6kafKJCV5bLfZDkF .messageLine1{stroke-width:1.5;stroke-dasharray:2, 2;stroke:#333}#mermaid-svg-6kafKJCV5bLfZDkF #arrowhead path{fill:#333;stroke:#333}#mermaid-svg-6kafKJCV5bLfZDkF .sequenceNumber{fill:#fff}#mermaid-svg-6kafKJCV5bLfZDkF #sequencenumber{fill:#333}#mermaid-svg-6kafKJCV5bLfZDkF #crosshead path{fill:#333;stroke:#333}#mermaid-svg-6kafKJCV5bLfZDkF .messageText{fill:#333;stroke:#333}#mermaid-svg-6kafKJCV5bLfZDkF .labelBox{stroke:#ccf;fill:#ECECFF}#mermaid-svg-6kafKJCV5bLfZDkF .labelText,#mermaid-svg-6kafKJCV5bLfZDkF .labelText>tspan{fill:#000;stroke:none}#mermaid-svg-6kafKJCV5bLfZDkF .loopText,#mermaid-svg-6kafKJCV5bLfZDkF .loopText>tspan{fill:#000;stroke:none}#mermaid-svg-6kafKJCV5bLfZDkF .loopLine{stroke-width:2px;stroke-dasharray:2, 2;stroke:#ccf;fill:#ccf}#mermaid-svg-6kafKJCV5bLfZDkF .note{stroke:#aa3;fill:#fff5ad}#mermaid-svg-6kafKJCV5bLfZDkF .noteText,#mermaid-svg-6kafKJCV5bLfZDkF .noteText>tspan{fill:#000;stroke:none}#mermaid-svg-6kafKJCV5bLfZDkF .activation0{fill:#f4f4f4;stroke:#666}#mermaid-svg-6kafKJCV5bLfZDkF .activation1{fill:#f4f4f4;stroke:#666}#mermaid-svg-6kafKJCV5bLfZDkF .activation2{fill:#f4f4f4;stroke:#666}#mermaid-svg-6kafKJCV5bLfZDkF .mermaid-main-font{font-family:"trebuchet ms", verdana, arial;font-family:var(--mermaid-font-family)}#mermaid-svg-6kafKJCV5bLfZDkF .section{stroke:none;opacity:0.2}#mermaid-svg-6kafKJCV5bLfZDkF .section0{fill:rgba(102,102,255,0.49)}#mermaid-svg-6kafKJCV5bLfZDkF .section2{fill:#fff400}#mermaid-svg-6kafKJCV5bLfZDkF .section1,#mermaid-svg-6kafKJCV5bLfZDkF .section3{fill:#fff;opacity:0.2}#mermaid-svg-6kafKJCV5bLfZDkF .sectionTitle0{fill:#333}#mermaid-svg-6kafKJCV5bLfZDkF .sectionTitle1{fill:#333}#mermaid-svg-6kafKJCV5bLfZDkF .sectionTitle2{fill:#333}#mermaid-svg-6kafKJCV5bLfZDkF .sectionTitle3{fill:#333}#mermaid-svg-6kafKJCV5bLfZDkF .sectionTitle{text-anchor:start;font-size:11px;text-height:14px;font-family:'trebuchet ms', verdana, arial;font-family:var(--mermaid-font-family)}#mermaid-svg-6kafKJCV5bLfZDkF .grid .tick{stroke:#d3d3d3;opacity:0.8;shape-rendering:crispEdges}#mermaid-svg-6kafKJCV5bLfZDkF .grid .tick text{font-family:'trebuchet ms', verdana, arial;font-family:var(--mermaid-font-family)}#mermaid-svg-6kafKJCV5bLfZDkF .grid path{stroke-width:0}#mermaid-svg-6kafKJCV5bLfZDkF .today{fill:none;stroke:red;stroke-width:2px}#mermaid-svg-6kafKJCV5bLfZDkF .task{stroke-width:2}#mermaid-svg-6kafKJCV5bLfZDkF .taskText{text-anchor:middle;font-family:'trebuchet ms', verdana, arial;font-family:var(--mermaid-font-family)}#mermaid-svg-6kafKJCV5bLfZDkF .taskText:not([font-size]){font-size:11px}#mermaid-svg-6kafKJCV5bLfZDkF .taskTextOutsideRight{fill:#000;text-anchor:start;font-size:11px;font-family:'trebuchet ms', verdana, arial;font-family:var(--mermaid-font-family)}#mermaid-svg-6kafKJCV5bLfZDkF .taskTextOutsideLeft{fill:#000;text-anchor:end;font-size:11px}#mermaid-svg-6kafKJCV5bLfZDkF .task.clickable{cursor:pointer}#mermaid-svg-6kafKJCV5bLfZDkF .taskText.clickable{cursor:pointer;fill:#003163 !important;font-weight:bold}#mermaid-svg-6kafKJCV5bLfZDkF .taskTextOutsideLeft.clickable{cursor:pointer;fill:#003163 !important;font-weight:bold}#mermaid-svg-6kafKJCV5bLfZDkF .taskTextOutsideRight.clickable{cursor:pointer;fill:#003163 !important;font-weight:bold}#mermaid-svg-6kafKJCV5bLfZDkF .taskText0,#mermaid-svg-6kafKJCV5bLfZDkF .taskText1,#mermaid-svg-6kafKJCV5bLfZDkF .taskText2,#mermaid-svg-6kafKJCV5bLfZDkF .taskText3{fill:#fff}#mermaid-svg-6kafKJCV5bLfZDkF .task0,#mermaid-svg-6kafKJCV5bLfZDkF .task1,#mermaid-svg-6kafKJCV5bLfZDkF .task2,#mermaid-svg-6kafKJCV5bLfZDkF .task3{fill:#8a90dd;stroke:#534fbc}#mermaid-svg-6kafKJCV5bLfZDkF .taskTextOutside0,#mermaid-svg-6kafKJCV5bLfZDkF .taskTextOutside2{fill:#000}#mermaid-svg-6kafKJCV5bLfZDkF .taskTextOutside1,#mermaid-svg-6kafKJCV5bLfZDkF .taskTextOutside3{fill:#000}#mermaid-svg-6kafKJCV5bLfZDkF .active0,#mermaid-svg-6kafKJCV5bLfZDkF .active1,#mermaid-svg-6kafKJCV5bLfZDkF .active2,#mermaid-svg-6kafKJCV5bLfZDkF .active3{fill:#bfc7ff;stroke:#534fbc}#mermaid-svg-6kafKJCV5bLfZDkF .activeText0,#mermaid-svg-6kafKJCV5bLfZDkF .activeText1,#mermaid-svg-6kafKJCV5bLfZDkF .activeText2,#mermaid-svg-6kafKJCV5bLfZDkF .activeText3{fill:#000 !important}#mermaid-svg-6kafKJCV5bLfZDkF .done0,#mermaid-svg-6kafKJCV5bLfZDkF .done1,#mermaid-svg-6kafKJCV5bLfZDkF .done2,#mermaid-svg-6kafKJCV5bLfZDkF .done3{stroke:grey;fill:#d3d3d3;stroke-width:2}#mermaid-svg-6kafKJCV5bLfZDkF .doneText0,#mermaid-svg-6kafKJCV5bLfZDkF .doneText1,#mermaid-svg-6kafKJCV5bLfZDkF .doneText2,#mermaid-svg-6kafKJCV5bLfZDkF .doneText3{fill:#000 !important}#mermaid-svg-6kafKJCV5bLfZDkF .crit0,#mermaid-svg-6kafKJCV5bLfZDkF .crit1,#mermaid-svg-6kafKJCV5bLfZDkF .crit2,#mermaid-svg-6kafKJCV5bLfZDkF .crit3{stroke:#f88;fill:red;stroke-width:2}#mermaid-svg-6kafKJCV5bLfZDkF .activeCrit0,#mermaid-svg-6kafKJCV5bLfZDkF .activeCrit1,#mermaid-svg-6kafKJCV5bLfZDkF .activeCrit2,#mermaid-svg-6kafKJCV5bLfZDkF .activeCrit3{stroke:#f88;fill:#bfc7ff;stroke-width:2}#mermaid-svg-6kafKJCV5bLfZDkF .doneCrit0,#mermaid-svg-6kafKJCV5bLfZDkF .doneCrit1,#mermaid-svg-6kafKJCV5bLfZDkF .doneCrit2,#mermaid-svg-6kafKJCV5bLfZDkF .doneCrit3{stroke:#f88;fill:#d3d3d3;stroke-width:2;cursor:pointer;shape-rendering:crispEdges}#mermaid-svg-6kafKJCV5bLfZDkF .milestone{transform:rotate(45deg) scale(0.8, 0.8)}#mermaid-svg-6kafKJCV5bLfZDkF .milestoneText{font-style:italic}#mermaid-svg-6kafKJCV5bLfZDkF .doneCritText0,#mermaid-svg-6kafKJCV5bLfZDkF .doneCritText1,#mermaid-svg-6kafKJCV5bLfZDkF .doneCritText2,#mermaid-svg-6kafKJCV5bLfZDkF .doneCritText3{fill:#000 !important}#mermaid-svg-6kafKJCV5bLfZDkF .activeCritText0,#mermaid-svg-6kafKJCV5bLfZDkF .activeCritText1,#mermaid-svg-6kafKJCV5bLfZDkF .activeCritText2,#mermaid-svg-6kafKJCV5bLfZDkF .activeCritText3{fill:#000 !important}#mermaid-svg-6kafKJCV5bLfZDkF .titleText{text-anchor:middle;font-size:18px;fill:#000;font-family:'trebuchet ms', verdana, arial;font-family:var(--mermaid-font-family)}#mermaid-svg-6kafKJCV5bLfZDkF g.classGroup text{fill:#9370db;stroke:none;font-family:'trebuchet ms', verdana, arial;font-family:var(--mermaid-font-family);font-size:10px}#mermaid-svg-6kafKJCV5bLfZDkF g.classGroup text .title{font-weight:bolder}#mermaid-svg-6kafKJCV5bLfZDkF g.clickable{cursor:pointer}#mermaid-svg-6kafKJCV5bLfZDkF g.classGroup rect{fill:#ECECFF;stroke:#9370db}#mermaid-svg-6kafKJCV5bLfZDkF g.classGroup line{stroke:#9370db;stroke-width:1}#mermaid-svg-6kafKJCV5bLfZDkF .classLabel .box{stroke:none;stroke-width:0;fill:#ECECFF;opacity:0.5}#mermaid-svg-6kafKJCV5bLfZDkF .classLabel .label{fill:#9370db;font-size:10px}#mermaid-svg-6kafKJCV5bLfZDkF .relation{stroke:#9370db;stroke-width:1;fill:none}#mermaid-svg-6kafKJCV5bLfZDkF .dashed-line{stroke-dasharray:3}#mermaid-svg-6kafKJCV5bLfZDkF #compositionStart{fill:#9370db;stroke:#9370db;stroke-width:1}#mermaid-svg-6kafKJCV5bLfZDkF #compositionEnd{fill:#9370db;stroke:#9370db;stroke-width:1}#mermaid-svg-6kafKJCV5bLfZDkF #aggregationStart{fill:#ECECFF;stroke:#9370db;stroke-width:1}#mermaid-svg-6kafKJCV5bLfZDkF #aggregationEnd{fill:#ECECFF;stroke:#9370db;stroke-width:1}#mermaid-svg-6kafKJCV5bLfZDkF #dependencyStart{fill:#9370db;stroke:#9370db;stroke-width:1}#mermaid-svg-6kafKJCV5bLfZDkF #dependencyEnd{fill:#9370db;stroke:#9370db;stroke-width:1}#mermaid-svg-6kafKJCV5bLfZDkF #extensionStart{fill:#9370db;stroke:#9370db;stroke-width:1}#mermaid-svg-6kafKJCV5bLfZDkF #extensionEnd{fill:#9370db;stroke:#9370db;stroke-width:1}#mermaid-svg-6kafKJCV5bLfZDkF .commit-id,#mermaid-svg-6kafKJCV5bLfZDkF .commit-msg,#mermaid-svg-6kafKJCV5bLfZDkF .branch-label{fill:lightgrey;color:lightgrey;font-family:'trebuchet ms', verdana, arial;font-family:var(--mermaid-font-family)}#mermaid-svg-6kafKJCV5bLfZDkF .pieTitleText{text-anchor:middle;font-size:25px;fill:#000;font-family:'trebuchet ms', verdana, arial;font-family:var(--mermaid-font-family)}#mermaid-svg-6kafKJCV5bLfZDkF .slice{font-family:'trebuchet ms', verdana, arial;font-family:var(--mermaid-font-family)}#mermaid-svg-6kafKJCV5bLfZDkF g.stateGroup text{fill:#9370db;stroke:none;font-size:10px;font-family:'trebuchet ms', verdana, arial;font-family:var(--mermaid-font-family)}#mermaid-svg-6kafKJCV5bLfZDkF g.stateGroup text{fill:#9370db;fill:#333;stroke:none;font-size:10px}#mermaid-svg-6kafKJCV5bLfZDkF g.statediagram-cluster .cluster-label text{fill:#333}#mermaid-svg-6kafKJCV5bLfZDkF g.stateGroup .state-title{font-weight:bolder;fill:#000}#mermaid-svg-6kafKJCV5bLfZDkF g.stateGroup rect{fill:#ECECFF;stroke:#9370db}#mermaid-svg-6kafKJCV5bLfZDkF g.stateGroup line{stroke:#9370db;stroke-width:1}#mermaid-svg-6kafKJCV5bLfZDkF .transition{stroke:#9370db;stroke-width:1;fill:none}#mermaid-svg-6kafKJCV5bLfZDkF .stateGroup .composit{fill:white;border-bottom:1px}#mermaid-svg-6kafKJCV5bLfZDkF .stateGroup .alt-composit{fill:#e0e0e0;border-bottom:1px}#mermaid-svg-6kafKJCV5bLfZDkF .state-note{stroke:#aa3;fill:#fff5ad}#mermaid-svg-6kafKJCV5bLfZDkF .state-note text{fill:black;stroke:none;font-size:10px}#mermaid-svg-6kafKJCV5bLfZDkF .stateLabel .box{stroke:none;stroke-width:0;fill:#ECECFF;opacity:0.7}#mermaid-svg-6kafKJCV5bLfZDkF .edgeLabel text{fill:#333}#mermaid-svg-6kafKJCV5bLfZDkF .stateLabel text{fill:#000;font-size:10px;font-weight:bold;font-family:'trebuchet ms', verdana, arial;font-family:var(--mermaid-font-family)}#mermaid-svg-6kafKJCV5bLfZDkF .node circle.state-start{fill:black;stroke:black}#mermaid-svg-6kafKJCV5bLfZDkF .node circle.state-end{fill:black;stroke:white;stroke-width:1.5}#mermaid-svg-6kafKJCV5bLfZDkF #statediagram-barbEnd{fill:#9370db}#mermaid-svg-6kafKJCV5bLfZDkF .statediagram-cluster rect{fill:#ECECFF;stroke:#9370db;stroke-width:1px}#mermaid-svg-6kafKJCV5bLfZDkF .statediagram-cluster rect.outer{rx:5px;ry:5px}#mermaid-svg-6kafKJCV5bLfZDkF .statediagram-state .divider{stroke:#9370db}#mermaid-svg-6kafKJCV5bLfZDkF .statediagram-state .title-state{rx:5px;ry:5px}#mermaid-svg-6kafKJCV5bLfZDkF .statediagram-cluster.statediagram-cluster .inner{fill:white}#mermaid-svg-6kafKJCV5bLfZDkF .statediagram-cluster.statediagram-cluster-alt .inner{fill:#e0e0e0}#mermaid-svg-6kafKJCV5bLfZDkF .statediagram-cluster .inner{rx:0;ry:0}#mermaid-svg-6kafKJCV5bLfZDkF .statediagram-state rect.basic{rx:5px;ry:5px}#mermaid-svg-6kafKJCV5bLfZDkF .statediagram-state rect.divider{stroke-dasharray:10,10;fill:#efefef}#mermaid-svg-6kafKJCV5bLfZDkF .note-edge{stroke-dasharray:5}#mermaid-svg-6kafKJCV5bLfZDkF .statediagram-note rect{fill:#fff5ad;stroke:#aa3;stroke-width:1px;rx:0;ry:0}:root{--mermaid-font-family: '"trebuchet ms", verdana, arial';--mermaid-font-family: "Comic Sans MS", "Comic Sans", cursive}#mermaid-svg-6kafKJCV5bLfZDkF .error-icon{fill:#522}#mermaid-svg-6kafKJCV5bLfZDkF .error-text{fill:#522;stroke:#522}#mermaid-svg-6kafKJCV5bLfZDkF .edge-thickness-normal{stroke-width:2px}#mermaid-svg-6kafKJCV5bLfZDkF .edge-thickness-thick{stroke-width:3.5px}#mermaid-svg-6kafKJCV5bLfZDkF .edge-pattern-solid{stroke-dasharray:0}#mermaid-svg-6kafKJCV5bLfZDkF .edge-pattern-dashed{stroke-dasharray:3}#mermaid-svg-6kafKJCV5bLfZDkF .edge-pattern-dotted{stroke-dasharray:2}#mermaid-svg-6kafKJCV5bLfZDkF .marker{fill:#333}#mermaid-svg-6kafKJCV5bLfZDkF .marker.cross{stroke:#333}
:root { --mermaid-font-family: "trebuchet ms", verdana, arial;}
#mermaid-svg-6kafKJCV5bLfZDkF {
color: rgba(0, 0, 0, 0.75);
font: ;
}
python基础复习
MLSQL数据库的学习
python相关库函数pandas,numpy等
数据分析
一些例子
数据分析概论:数据分析概论 数据分析关键:心智模型