https://pangyd.com/tags/%E5%B0%B1%E4%B8%9A/Recent content in 就业 on 庞玉栋个人博客Hugozh-cnThu, 22 Nov 2018 19:08:31 +0800https://pangyd.com/post/200/Mon, 01 Oct 2018 09:00:25 +0800https://pangyd.com/post/200/<p> </p><p align="center"><b><a name="_Toc518382491">大数据行业就业指南</a></b><span lang="EN-US"></span></p> <p>大数据开发工程师<span lang="EN-US">/</span>大数据运维<span lang="EN-US">/Hadoop</span>开发：<span lang="EN-US"></span></p> <p>熟悉<span lang="EN-US">Hadoop</span>生态圈（ <span lang="EN-US">MapReduce</span>，<span lang="EN-US">hdfs</span>，<span lang="EN-US">Hive</span>，<span lang="EN-US">Spark</span>等相关组件），<span lang="EN-US">liunx</span>（<span lang="EN-US">shell</span>脚本）相关技术以及对源码有深入认识，熟悉<span lang="EN-US">mysql</span>数据库等，掌握<span lang="EN-US">JAVA</span>语言或者<span lang="EN-US">python</span>语言 （有的公司要求掌握<span lang="EN-US">Scala</span>语言，流式处理框架使用经验，熟悉<span lang="EN-US">Tableau</span>报表设计<span lang="EN-US"></span></p> <p><span lang="EN-US">&nbsp;</span></p> <p>数据采集工程师<span lang="EN-US">/</span>网络爬虫工程师<span lang="EN-US">/</span>反爬虫工程师<span lang="EN-US">:</span></p> <p><span lang="EN-US"><span>&nbsp; </span></span>熟悉<span lang="EN-US">Selenium, phantomjs, scrapy</span>等自动化测试工具，以及爬虫框架，精通<span lang="EN-US">Java/Objective-C/python</span>等至少一种语言，了解各种前端技术，包括<span lang="EN-US">XHTML/XML/CSS/JavaScript/AJAX</span>等；熟悉正则表达式和<span lang="EN-US">XPATH</span>，能够从结构化或非结构化数据中获取信息；熟悉<span lang="EN-US">DDMS</span>、<span lang="EN-US">Instruments</span>，<span lang="EN-US">Charles</span>，<span lang="EN-US">Fildder</span>等抓包工具<span lang="EN-US">;</span>，熟悉网络编程，对<span lang="EN-US">TCP/IP</span>有深入理解，精通<span lang="EN-US">MySQL</span>或<span lang="EN-US">PostgreSQL</span>；熟悉<span lang="EN-US">Redis</span>或<span lang="EN-US">MongoDB</span>；了解<span lang="EN-US">linux</span>优先<span lang="EN-US"></span></p> <p>大数据分析工程师<span lang="EN-US">/</span>统计建模师<span lang="EN-US">/</span>数据管理<span lang="EN-US">/</span>数据统计<span lang="EN-US"></span></p> <p><span lang="EN-US"><span>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; </span></span>熟悉<span lang="EN-US">R/Spark/Python</span>或<span lang="EN-US">C/C++</span>等至少一个常用语言；以机器学习、深度学习、复杂网络、自然语言处理等其中一种或几种模型见长；对建模技术的前沿探索有热情，优秀的学习能力和逻辑思考能力；对风险管理、用户生命周期管理、或不同垂直领域有深入研究，对各式海量数据分析与挖掘有强烈兴趣。具备<span lang="EN-US">ETL</span>数据处理能力，有经验者优先，优秀的逻辑思维能力，和数据敏感度，可从海量数据中日趋分析并反推业务逻辑，优化核心业务流程；<span lang="EN-US"></span></p> <p>数据可视化工程师：<span lang="EN-US"></span></p> <p><span lang="EN-US">.<span>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; </span></span>理解<span lang="EN-US">W3C</span>标准与<span lang="EN-US">ES</span>规范，熟悉<span lang="EN-US">Web</span>语义化，掌握盒模型、常用布局以及浏览器兼容性；熟练掌握各项<span lang="EN-US">Web</span>前端技术<span lang="EN-US"> (HTML/CSS/Javascript) </span>，了解<span lang="EN-US">svg</span>，<span lang="EN-US">canvas</span>，<span lang="EN-US">webgl</span>技术；熟练掌握<span lang="EN-US">JET Charts/ECharts/HighCharts/D3.js/Three.js</span>等图形库熟练使用可视化<span lang="EN-US">BI</span>工具及前端工具，具有计算机图形学理论基础，熟悉数据可视化相关基础算法；熟悉<span lang="EN-US"> HTTP </span>协议及缓存，了解基本的浏览器渲染及网络传输过程，掌握<span lang="EN-US">Java/python</span>等一门语言，有前端开发经验<span lang="EN-US">/</span>大规模数据存储，处理经验者优先<span lang="EN-US"></span></p> <p><span lang="EN-US">&nbsp;</span></p><p></p>