BigData In Aws Or Aliyun

╰半橙微兮° 2021-12-01 13:16 207阅读 0赞

### 大数据通用系统解决方案（分别基于Open,AWS,Aliyun，和三者的使用技术） ###

### 应用场景 ###

物联网领域、车联网、智能城市，智能生活

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3RpYW55ZXNoaXll_size_16_color_FFFFFF_t_70][]

<table style="width:336pt;"> 
 <tbody> 
 <tr> 
 <td colspan="2" style="vertical-align:bottom;width:96pt;">MQTT</td> 
 <td colspan="3" style="vertical-align:bottom;width:144pt;">端和云之间的通信</td> 
 <td style="vertical-align:bottom;width:48pt;">&nbsp;</td> 
 <td style="vertical-align:bottom;width:48pt;">&nbsp;</td> 
 </tr> 
 <tr> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td colspan="4" style="vertical-align:bottom;">1 open&nbsp; -&nbsp; EMQ （百万级分布式开源物联网MQTT消息服务器）</td> 
 </tr> 
 <tr> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td colspan="4" style="vertical-align:bottom;">2 aws&nbsp;&nbsp; -&nbsp; AWS IoT</td> 
 </tr> 
 <tr> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td colspan="4" style="vertical-align:bottom;">3 ali&nbsp;&nbsp; -&nbsp; Aliyun IOT （包括 Aliyun MQTT）</td> 
 </tr> 
 <tr> 
 <td colspan="3" style="vertical-align:bottom;">消息中间件</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 </tr> 
 <tr> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">MQ</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td colspan="3" style="vertical-align:bottom;">1 open&nbsp; -&nbsp; Kafka</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 </tr> 
 <tr> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td colspan="4" style="vertical-align:bottom;">2 aws&nbsp;&nbsp; -&nbsp; Kinesis</td> 
 </tr> 
 <tr> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td colspan="4" style="vertical-align:bottom;">3 ali&nbsp;&nbsp; -&nbsp; RocketMQ</td> 
 </tr> 
 <tr> 
 <td colspan="4" style="vertical-align:bottom;">Infrastructure</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 </tr> 
 <tr> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">infra</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td colspan="4" style="vertical-align:bottom;">1 open&nbsp; -&nbsp; Ambari(Hotonworks)</td> 
 </tr> 
 <tr> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td colspan="2" style="vertical-align:bottom;">基盘搭建</td> 
 <td colspan="4" style="vertical-align:bottom;">2 aws&nbsp;&nbsp; -&nbsp; aws-emr</td> 
 </tr> 
 <tr> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td colspan="4" style="vertical-align:bottom;">3 ali&nbsp;&nbsp; -&nbsp; E-MapReduce</td> 
 </tr> 
 <tr> 
 <td colspan="2" style="vertical-align:bottom;">计算</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 </tr> 
 <tr> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td colspan="2" style="vertical-align:bottom;">Realtime Compute</td> 
 <td colspan="4" style="vertical-align:bottom;">1 open&nbsp; -&nbsp; Spark Streaming，Flink</td> 
 </tr> 
 <tr> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td colspan="2" style="vertical-align:bottom;">即时计算</td> 
 <td colspan="3" style="vertical-align:bottom;">2 aws&nbsp;&nbsp; -&nbsp; 暂无</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 </tr> 
 <tr> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td colspan="4" style="vertical-align:bottom;">3 ali&nbsp;&nbsp; -&nbsp; 阿里云实时计算(Alibaba Cloud Realtime Compute)，基于Flink</td> 
 </tr> 
 <tr> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 </tr> 
 <tr> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td colspan="2" style="vertical-align:bottom;">Batch Compute</td> 
 <td colspan="4" style="vertical-align:bottom;">1 open&nbsp; -&nbsp; Spark Batch, Hadoop MR</td> 
 </tr> 
 <tr> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td colspan="2" style="vertical-align:bottom;">离线计算</td> 
 <td colspan="4" style="vertical-align:bottom;">2 aws&nbsp;&nbsp; -&nbsp; AWS Batch</td> 
 </tr> 
 <tr> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td colspan="4" style="vertical-align:bottom;">3 ali&nbsp;&nbsp; -&nbsp; BatchCompute</td> 
 </tr> 
 <tr> 
 <td colspan="2" style="vertical-align:bottom;">分析</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 </tr> 
 <tr> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td colspan="2" style="vertical-align:bottom;">Analysis</td> 
 <td colspan="4" style="vertical-align:bottom;">1 open&nbsp; -&nbsp; Apache Kylin™等</td> 
 </tr> 
 <tr> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">分析</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td colspan="4" style="vertical-align:bottom;">2 aws&nbsp;&nbsp; -&nbsp; Amazon QuickSight等</td> 
 </tr> 
 <tr> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td colspan="4" style="vertical-align:bottom;">3 ali&nbsp;&nbsp; -&nbsp; Quick BI，画像分析等</td> 
 </tr> 
 <tr> 
 <td colspan="2" style="vertical-align:bottom;">存储</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 </tr> 
 <tr> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td colspan="2" style="vertical-align:bottom;">File Store</td> 
 <td colspan="3" style="vertical-align:bottom;">1 open&nbsp; -&nbsp; HDFS</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 </tr> 
 <tr> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td colspan="2" style="vertical-align:bottom;">文件存储</td> 
 <td colspan="3" style="vertical-align:bottom;">2 aws&nbsp;&nbsp; -&nbsp; FSx</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 </tr> 
 <tr> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td colspan="3" style="vertical-align:bottom;">3 ali&nbsp;&nbsp; -&nbsp; NAS</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 </tr> 
 <tr> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 </tr> 
 <tr> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td colspan="2" style="vertical-align:bottom;">Object Store</td> 
 <td colspan="3" style="vertical-align:bottom;">1 open&nbsp; -&nbsp; Swift</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 </tr> 
 <tr> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td colspan="2" style="vertical-align:bottom;">对象存储</td> 
 <td colspan="3" style="vertical-align:bottom;">2 aws&nbsp;&nbsp; -&nbsp; S3</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 </tr> 
 <tr> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td colspan="3" style="vertical-align:bottom;">3 ali&nbsp;&nbsp; -&nbsp; OSS</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 </tr> 
 <tr> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 </tr> 
 <tr> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td colspan="2" style="vertical-align:bottom;">NoSql DB</td> 
 <td colspan="3" style="vertical-align:bottom;">1 open&nbsp; -&nbsp; HBase</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 </tr> 
 <tr> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td colspan="4" style="vertical-align:bottom;">2 aws&nbsp;&nbsp; -&nbsp; DynamoDB&nbsp;</td> 
 </tr> 
 <tr> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td colspan="4" style="vertical-align:bottom;">3 ali&nbsp;&nbsp; -&nbsp; OceanBase</td> 
 </tr> 
 <tr> 
 <td colspan="2" style="vertical-align:bottom;">缓存</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 </tr> 
 <tr> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td colspan="2" style="vertical-align:bottom;">Data Cache</td> 
 <td colspan="4" style="vertical-align:bottom;">1 open&nbsp; -&nbsp; Redis，Memcached</td> 
 </tr> 
 <tr> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">缓存</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td colspan="4" style="vertical-align:bottom;">2 aws&nbsp;&nbsp; -&nbsp; Amazon ElastiCache（Redis 和 Memcached 引擎之上）</td> 
 </tr> 
 <tr> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td colspan="4" style="vertical-align:bottom;">3 ali&nbsp;&nbsp; -&nbsp; 阿里云数据库 Redis 版（ApsaraDB for Redis）是兼容开源 Redis 协议的 Key-Value 类型在线存储服务</td> 
 </tr> 
 <tr> 
 <td colspan="2" style="vertical-align:bottom;">搜索</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 </tr> 
 <tr> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td colspan="2" style="vertical-align:bottom;">Data Search</td> 
 <td colspan="4" style="vertical-align:bottom;">1 open&nbsp; -&nbsp; Elasticsearch</td> 
 </tr> 
 <tr> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td colspan="2" style="vertical-align:bottom;">搜索引擎</td> 
 <td colspan="4" style="vertical-align:bottom;">2 aws&nbsp;&nbsp; -&nbsp; Amazon ES (基于开源Elasticsearch一种常见的开源搜索和分析引擎）</td> 
 </tr> 
 <tr> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td colspan="4" style="vertical-align:bottom;">3 ali&nbsp;&nbsp; -&nbsp; 阿里云Elasticsearch，提供基于开源Elasticsearch服务</td> 
 </tr> 
 <tr> 
 <td colspan="2" style="vertical-align:bottom;">数据仓库</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 </tr> 
 <tr> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td colspan="2" style="vertical-align:bottom;">data warehousing</td> 
 <td colspan="3" style="vertical-align:bottom;">1 open&nbsp; -&nbsp; Hive</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 </tr> 
 <tr> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td colspan="2" style="vertical-align:bottom;">数据仓库</td> 
 <td colspan="4" style="vertical-align:bottom;">2 aws&nbsp;&nbsp; -&nbsp; Amazon Redshift</td> 
 </tr> 
 <tr> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td style="vertical-align:bottom;">&nbsp;</td> 
 <td colspan="4" style="vertical-align:bottom;">3 ali&nbsp;&nbsp; -&nbsp; Data Lake Analytics</td> 
 </tr> 
 </tbody> 
</table>

[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3RpYW55ZXNoaXll_size_16_color_FFFFFF_t_70]: /images/20211201/296e3c749d6245c68f96a5924b2f0835.png