HBase Java API操作数据库

秒速五厘米 2022-09-05 05:19 256阅读 0赞

# 场景 #

CentOS7上搭建Hadoop集群(入门级)：

[https://blog.csdn.net/BADAO\_LIUMANG\_QIZHI/article/details/119335883][https_blog.csdn.net_BADAO_LIUMANG_QIZHI_article_details_119335883]：

HBase在CentOS上分布集群安装：

[https://blog.csdn.net/BADAO\_LIUMANG\_QIZHI/article/details/119511593][https_blog.csdn.net_BADAO_LIUMANG_QIZHI_article_details_119511593]

在上面将开发环境搭建起来，要想操作操作数据库除了使用HBase Shell

HBase Shell常用的命令:

[https://blog.csdn.net/BADAO\_LIUMANG\_QIZHI/article/details/119516818][https_blog.csdn.net_BADAO_LIUMANG_QIZHI_article_details_119516818]

还可以使用JAVA API对HBase进行操作。

注：

博客：  
[https://blog.csdn.net/badao\_liumang\_qizhi][https_blog.csdn.net_badao_liumang_qizhi]  
关注公众号  
霸道的程序猿  
获取编程相关电子书、教程推送与免费下载。

## HBase Java API 与HBase数据模型的对应关系 ##

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0JBREFPX0xJVU1BTkdfUUlaSEk_size_16_color_FFFFFF_t_70][]

# 实现 #

1、首先在IDEA中新建Maven项目，pom文件中添加依赖

<dependencies>
            <dependency>
                <groupId>org.apache.hbase</groupId>
                <artifactId>hbase-client</artifactId>
                <version>2.4.5</version>
            </dependency>
            <dependency>
                <groupId>org.apache.hbase</groupId>
                <artifactId>hbase-common</artifactId>
                <version>2.4.5</version>
            </dependency>
            <dependency>
                <groupId>org.apache.hbase</groupId>
                <artifactId>hbase-protocol</artifactId>
                <version>2.4.5</version>
            </dependency>
            <dependency>
                <groupId>org.apache.hbase</groupId>
                <artifactId>hbase-server</artifactId>
                <version>2.4.5</version>
            </dependency>
            <dependency>
                <groupId>junit</groupId>
                <artifactId>junit</artifactId>
                <version>4.12</version>
            </dependency>
        </dependencies>

2、然后新建包，包下新建类，首先新建建立连接和关闭连接的方法

public static Configuration cfg = HBaseConfiguration.create();
        public static Connection conn;
    
        /**
         * 建立连接
         * @throws IOException
         */
        public static void getConn() throws IOException {
            cfg.set("hbase.zookeeper.quorum","192.168.148.128:2181,192.168.148.131:2181,192.168.148.132:2181");
            //创建数据库连接
            conn = ConnectionFactory.createConnection(cfg);
        }
    
        /**
         * 关闭连接
         * @throws IOException
         */
        public static void closeConn() throws IOException {
            conn.close();
        }

然后这里的zookeeper的配置参考上面配置HBase的hbase-site.xml中的配置。

这里配置的是master、slave1、slave2的ip,另外要在本地电脑hosts文件中加上集群节点的映射。

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0JBREFPX0xJVU1BTkdfUUlaSEk_size_16_color_FFFFFF_t_70 1][]

3、获取所有表，新建方法

/**
         * 列出所有的表
         * @throws IOException
         */
        public static void listAllTable() throws IOException {
            //Admin 用于管理HBase数据库的表信息
            Admin admin = conn.getAdmin();
            for(TableName name : admin.listTableNames())
            {
                System.out.println(name);
            }
        }

然后在main方法中调用

public static void main(String[] args) throws IOException {
            getConn();
            listAllTable();
            closeConn();
        }

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0JBREFPX0xJVU1BTkdfUUlaSEk_size_16_color_FFFFFF_t_70 2][]

注意：

org.apache.hadoop.hbase.client.Admin是为管理HBase而提供的接口，在Connection

实例调用getAdmin()和close()方法期间有效。使用Admin接口可以实现的主要

HBase Shell命令包括create, list, drop, enable, disable, alter，相应方法如下所示。

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0JBREFPX0xJVU1BTkdfUUlaSEk_size_16_color_FFFFFF_t_70 3][]

4、创建表方法

/*
        创建表
         */
        public static void createTable(String tableName,String ...familyNames) throws IOException {
            //Admin 用于管理HBase数据库的表信息
            Admin admin = conn.getAdmin();
            //表名
            TableName tn = TableName.valueOf(tableName);
            //如果表已经存在
            if(admin.tableExists(tn))
            {
                //先使表无效
                admin.disableTable(tn);
                //删除表
                admin.deleteTable(tn);
            }
            //HTableDescriptor 包含了表的名字及其对应的列族
            HTableDescriptor hTableDescriptor = new HTableDescriptor(tn);
            for(String family:familyNames)
            {
                hTableDescriptor.addFamily(new HColumnDescriptor(family));
            }
            admin.createTable(hTableDescriptor);
            admin.close();
        }

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0JBREFPX0xJVU1BTkdfUUlaSEk_size_16_color_FFFFFF_t_70 4][]

5、查看表结构方法

/*
        查看表结构
         */
        public static void describe(String tableName) throws IOException {
            Admin admin = conn.getAdmin();
            TableName tn = TableName.valueOf(tableName);
            HTableDescriptor hTableDescriptor = admin.getTableDescriptor(tn);
            for(HColumnDescriptor hcd :hTableDescriptor.getColumnFamilies())
            {
                System.out.println(hcd.getNameAsString());
            }
        }

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0JBREFPX0xJVU1BTkdfUUlaSEk_size_16_color_FFFFFF_t_70 5][]

6、插入数据方法

/*
            插入数据
         */
        public static void putdata() throws IOException {
            cfg.set("hbase.zookeeper.quorum","192.168.148.128:2181,192.168.148.131:2181,192.168.148.132:2181");
            //创建数据库连接
            conn = ConnectionFactory.createConnection(cfg);
            Table tb = conn.getTable(TableName.valueOf("scores"));
            Put p = new Put(Bytes.toBytes("zhangsan"));
            p.addColumn(Bytes.toBytes("grade"),Bytes.toBytes(""),Bytes.toBytes("3"));
            p.addColumn(Bytes.toBytes("grade"),Bytes.toBytes("math"),Bytes.toBytes("58"));
            p.addColumn(Bytes.toBytes("course"),Bytes.toBytes("art"),Bytes.toBytes("98"));
            tb.put(p);
        }

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0JBREFPX0xJVU1BTkdfUUlaSEk_size_16_color_FFFFFF_t_70 6][]

注意：

Table接口用于和HBase中的表进行通信，代表了该表的实例，使用Connection的

getTable(TableName tableName)方法可以获取该接口的实例，用于获取、添加、删除、扫描HBase表中的数据。

Table接口包含的主要方法如下

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0JBREFPX0xJVU1BTkdfUUlaSEk_size_16_color_FFFFFF_t_70 7][]

7、获取数据方法

/*
        获取数据
        */
        public static void getdata() throws IOException {
            cfg.set("hbase.zookeeper.quorum","192.168.148.128:2181,192.168.148.131:2181,192.168.148.132:2181");
            //创建数据库连接
            conn = ConnectionFactory.createConnection(cfg);
            Table tb = conn.getTable(TableName.valueOf("scores"));
            Get get = new Get(Bytes.toBytes("zhangsan"));
            //get.addFamily(Bytes.toBytes("grade"));
            //get.addColumn(Bytes.toBytes("grade"),Bytes.toBytes("math"));
            Result result = tb.get(get);
            System.out.println(String.format("resule.value=%s,resule.toString():%s",Bytes.toString(result.value()),result));
        }

注意：

按行键获取

Get get = new Get(Bytes.toBytes("zhangsan"));

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0JBREFPX0xJVU1BTkdfUUlaSEk_size_16_color_FFFFFF_t_70 8][]

按行键、列族获取

Get get = new Get(Bytes.toBytes("zhangsan"));
    get.addFamily(Bytes.toBytes("grade"));

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0JBREFPX0xJVU1BTkdfUUlaSEk_size_16_color_FFFFFF_t_70 9][]  
按行键、列族、列修饰符获取

Get get = new Get(Bytes.toBytes("zhangsan"));
    get.addColumn(Bytes.toBytes("grade"),Bytes.toBytes("math"));

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0JBREFPX0xJVU1BTkdfUUlaSEk_size_16_color_FFFFFF_t_70 10][]

## 示例代码下载 ##

[https://download.csdn.net/download/BADAO\_LIUMANG\_QIZHI/21114101][https_download.csdn.net_download_BADAO_LIUMANG_QIZHI_21114101]

[https_blog.csdn.net_BADAO_LIUMANG_QIZHI_article_details_119335883]: https://blog.csdn.net/BADAO_LIUMANG_QIZHI/article/details/119335883
[https_blog.csdn.net_BADAO_LIUMANG_QIZHI_article_details_119511593]: https://blog.csdn.net/BADAO_LIUMANG_QIZHI/article/details/119511593
[https_blog.csdn.net_BADAO_LIUMANG_QIZHI_article_details_119516818]: https://blog.csdn.net/BADAO_LIUMANG_QIZHI/article/details/119516818
[https_blog.csdn.net_badao_liumang_qizhi]: https://blog.csdn.net/badao_liumang_qizhi
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0JBREFPX0xJVU1BTkdfUUlaSEk_size_16_color_FFFFFF_t_70]: /images/20220829/f858d62924a04935935d9eb35dbed8bc.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0JBREFPX0xJVU1BTkdfUUlaSEk_size_16_color_FFFFFF_t_70 1]: /images/20220829/d975fa998eda46f0a94096dd6e40052d.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0JBREFPX0xJVU1BTkdfUUlaSEk_size_16_color_FFFFFF_t_70 2]: /images/20220829/b3ecd3ee1c0844479abcbb434cd10e6e.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0JBREFPX0xJVU1BTkdfUUlaSEk_size_16_color_FFFFFF_t_70 3]: /images/20220829/3103b83de5764f07a5e2885d568f1501.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0JBREFPX0xJVU1BTkdfUUlaSEk_size_16_color_FFFFFF_t_70 4]: /images/20220829/eab61ca9a7094eb789831d551698e6d7.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0JBREFPX0xJVU1BTkdfUUlaSEk_size_16_color_FFFFFF_t_70 5]: /images/20220829/172627ff681c4e4c8da64a458e7b07f2.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0JBREFPX0xJVU1BTkdfUUlaSEk_size_16_color_FFFFFF_t_70 6]: /images/20220829/0e96d5bbda25480aaa24a3e5957330ed.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0JBREFPX0xJVU1BTkdfUUlaSEk_size_16_color_FFFFFF_t_70 7]: /images/20220829/28a76709a0d344d39e083492a88258fd.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0JBREFPX0xJVU1BTkdfUUlaSEk_size_16_color_FFFFFF_t_70 8]: /images/20220829/5c8d39b7e91e43bf906e5f74a1525c1b.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0JBREFPX0xJVU1BTkdfUUlaSEk_size_16_color_FFFFFF_t_70 9]: /images/20220829/c8037ab3e39348dd88d7e4711b4cb155.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0JBREFPX0xJVU1BTkdfUUlaSEk_size_16_color_FFFFFF_t_70 10]: /images/20220829/5e1d5b3c58ae43538607875f461e3fea.png
[https_download.csdn.net_download_BADAO_LIUMANG_QIZHI_21114101]: https://download.csdn.net/download/BADAO_LIUMANG_QIZHI/21114101