[Hadoop] hadoop-2.6.0-cdh5.7.0 编译报错“maven-shade-plugin”解决

以你之姓@ 2022-05-16 13:34 153阅读 0赞

CDH版本hadoop（hadoop-2.6.0-cdh5.7.0）编译报错，使用编译加上-X命令打印出来详细错误信息：

[WARNING] Could not transfer metadata org.apache.maven.plugins:maven-shade-plugin/maven-metadata.xml from/to central (https://repo.maven.apache.org/maven2): Received fatal alert: protocol_version
    org.eclipse.aether.transfer.MetadataTransferException: Could not transfer metadata org.apache.maven.plugins:maven-shade-plugin/maven-metadata.xml from/to central (https://repo.maven.apache.org/maven2): Received fatal alert: protocol_version
    	at org.eclipse.aether.connector.basic.MetadataTransportListener.transferFailed(MetadataTransportListener.java:43)
    	at org.eclipse.aether.connector.basic.BasicRepositoryConnector$TaskRunner.run(BasicRepositoryConnector.java:355)
    	at org.eclipse.aether.util.concurrency.RunnableErrorForwarder$1.run(RunnableErrorForwarder.java:67)
    	at org.eclipse.aether.connector.basic.BasicRepositoryConnector$DirectExecutor.execute(BasicRepositoryConnector.java:581)
    	at org.eclipse.aether.connector.basic.BasicRepositoryConnector.get(BasicRepositoryConnector.java:222)
    	at org.eclipse.aether.internal.impl.DefaultMetadataResolver$ResolveTask.run(DefaultMetadataResolver.java:607)
    	at org.eclipse.aether.util.concurrency.RunnableErrorForwarder$1.run(RunnableErrorForwarder.java:67)
    	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
    	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
    	at java.lang.Thread.run(Thread.java:745)
    Caused by: org.apache.maven.wagon.TransferFailedException: Received fatal alert: protocol_version
    	at org.apache.maven.wagon.providers.http.AbstractHttpClientWagon.fillInputData(AbstractHttpClientWagon.java:1066)
    	at org.apache.maven.wagon.providers.http.AbstractHttpClientWagon.fillInputData(AbstractHttpClientWagon.java:960)
    	at org.apache.maven.wagon.StreamWagon.getInputStream(StreamWagon.java:116)
    	at org.apache.maven.wagon.StreamWagon.getIfNewer(StreamWagon.java:88)
    	at org.apache.maven.wagon.StreamWagon.get(StreamWagon.java:61)
    	at org.eclipse.aether.transport.wagon.WagonTransporter$GetTaskRunner.run(WagonTransporter.java:560)
    	at org.eclipse.aether.transport.wagon.WagonTransporter.execute(WagonTransporter.java:427)
    	at org.eclipse.aether.transport.wagon.WagonTransporter.get(WagonTransporter.java:404)
    	at org.eclipse.aether.connector.basic.BasicRepositoryConnector$GetTaskRunner.runTask(BasicRepositoryConnector.java:447)
    	at org.eclipse.aether.connector.basic.BasicRepositoryConnector$TaskRunner.run(BasicRepositoryConnector.java:350)
    	... 8 more
    Caused by: javax.net.ssl.SSLException: Received fatal alert: protocol_version
    	at sun.security.ssl.Alerts.getSSLException(Alerts.java:208)
    	at sun.security.ssl.Alerts.getSSLException(Alerts.java:154)
    	at sun.security.ssl.SSLSocketImpl.recvAlert(SSLSocketImpl.java:1979)
    	at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:1086)
    	at sun.security.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1332)
    	at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1359)
    	at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1343)
    	at org.apache.maven.wagon.providers.http.httpclient.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:275)
    	at org.apache.maven.wagon.providers.http.httpclient.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:254)
    	at org.apache.maven.wagon.providers.http.httpclient.impl.conn.HttpClientConnectionOperator.connect(HttpClientConnectionOperator.java:123)
    	at org.apache.maven.wagon.providers.http.httpclient.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:318)
    	at org.apache.maven.wagon.providers.http.httpclient.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:363)
    	at org.apache.maven.wagon.providers.http.httpclient.impl.execchain.MainClientExec.execute(MainClientExec.java:219)
    	at org.apache.maven.wagon.providers.http.httpclient.impl.execchain.ProtocolExec.execute(ProtocolExec.java:195)
    	at org.apache.maven.wagon.providers.http.httpclient.impl.execchain.RetryExec.execute(RetryExec.java:86)
    	at org.apache.maven.wagon.providers.http.httpclient.impl.execchain.RedirectExec.execute(RedirectExec.java:108)
    	at org.apache.maven.wagon.providers.http.httpclient.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:184)
    	at org.apache.maven.wagon.providers.http.httpclient.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
    	at org.apache.maven.wagon.providers.http.AbstractHttpClientWagon.execute(AbstractHttpClientWagon.java:832)
    	at org.apache.maven.wagon.providers.http.AbstractHttpClientWagon.fillInputData(AbstractHttpClientWagon.java:983)
    	... 17 more
    [INFO] ------------------------------------------------------------------------
    [INFO] Reactor Summary:
    [INFO] 
    [INFO] Apache Hadoop Main ................................. SUCCESS [  1.015 s]
    [INFO] Apache Hadoop Project POM .......................... SUCCESS [  0.686 s]
    [INFO] Apache Hadoop Annotations .......................... SUCCESS [  2.053 s]
    [INFO] Apache Hadoop Assemblies ........................... SUCCESS [  0.283 s]
    [INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [  2.209 s]
    [INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [ 12.924 s]
    [INFO] Apache Hadoop MiniKDC .............................. SUCCESS [  3.146 s]
    [INFO] Apache Hadoop Auth ................................. SUCCESS [  3.298 s]
    [INFO] Apache Hadoop Auth Examples ........................ SUCCESS [  2.142 s]
    [INFO] Apache Hadoop Common ............................... SUCCESS [01:26 min]
    [INFO] Apache Hadoop NFS .................................. SUCCESS [  3.757 s]
    [INFO] Apache Hadoop KMS .................................. SUCCESS [ 11.483 s]
    [INFO] Apache Hadoop Common Project ....................... SUCCESS [  0.031 s]
    [INFO] Apache Hadoop HDFS ................................. FAILURE [  1.844 s]
    [INFO] Apache Hadoop HttpFS ............................... SKIPPED
    [INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
    [INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED
    [INFO] Apache Hadoop HDFS Project ......................... SKIPPED
    [INFO] hadoop-yarn ........................................ SKIPPED
    [INFO] hadoop-yarn-api .................................... SKIPPED
    [INFO] hadoop-yarn-common ................................. SKIPPED
    [INFO] hadoop-yarn-server ................................. SKIPPED
    [INFO] hadoop-yarn-server-common .......................... SKIPPED
    [INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED
    [INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED
    [INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
    [INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED
    [INFO] hadoop-yarn-server-tests ........................... SKIPPED
    [INFO] hadoop-yarn-client ................................. SKIPPED
    [INFO] hadoop-yarn-applications ........................... SKIPPED
    [INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED
    [INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
    [INFO] hadoop-yarn-site ................................... SKIPPED
    [INFO] hadoop-yarn-registry ............................... SKIPPED
    [INFO] hadoop-yarn-project ................................ SKIPPED
    [INFO] hadoop-mapreduce-client ............................ SKIPPED
    [INFO] hadoop-mapreduce-client-core ....................... SKIPPED
    [INFO] hadoop-mapreduce-client-common ..................... SKIPPED
    [INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED
    [INFO] hadoop-mapreduce-client-app ........................ SKIPPED
    [INFO] hadoop-mapreduce-client-hs ......................... SKIPPED
    [INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED
    [INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED
    [INFO] hadoop-mapreduce-client-nativetask ................. SKIPPED
    [INFO] Apache Hadoop MapReduce Examples ................... SKIPPED
    [INFO] hadoop-mapreduce ................................... SKIPPED
    [INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED
    [INFO] Apache Hadoop Distributed Copy ..................... SKIPPED
    [INFO] Apache Hadoop Archives ............................. SKIPPED
    [INFO] Apache Hadoop Archive Logs ......................... SKIPPED
    [INFO] Apache Hadoop Rumen ................................ SKIPPED
    [INFO] Apache Hadoop Gridmix .............................. SKIPPED
    [INFO] Apache Hadoop Data Join ............................ SKIPPED
    [INFO] Apache Hadoop Ant Tasks ............................ SKIPPED
    [INFO] Apache Hadoop Extras ............................... SKIPPED
    [INFO] Apache Hadoop Pipes ................................ SKIPPED
    [INFO] Apache Hadoop OpenStack support .................... SKIPPED
    [INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
    [INFO] Apache Hadoop Azure support ........................ SKIPPED
    [INFO] Apache Hadoop Client ............................... SKIPPED
    [INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
    [INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
    [INFO] Apache Hadoop Tools Dist ........................... SKIPPED
    [INFO] Apache Hadoop Tools ................................ SKIPPED
    [INFO] Apache Hadoop Distribution ......................... SKIPPED
    [INFO] ------------------------------------------------------------------------
    [INFO] BUILD FAILURE
    [INFO] ------------------------------------------------------------------------
    [INFO] Total time: 02:13 min
    [INFO] Finished at: 2018-08-21T13:35:50+08:00
    [INFO] Final Memory: 134M/2530M
    [INFO] ------------------------------------------------------------------------
    [ERROR] Error resolving version for plugin 'org.apache.maven.plugins:maven-shade-plugin' from the repositories [local (/home/hadoop/maven_repo), cdh.releases.repo (https://repository.cloudera.com/content/repositories/cdh-releases-rcs), cdh.snapshots.repo (https://repository.cloudera.com/content/repositories/snapshots), central (https://repo.maven.apache.org/maven2)]: Plugin not found in any plugin repository -> [Help 1]
    org.apache.maven.plugin.version.PluginVersionResolutionException: Error resolving version for plugin 'org.apache.maven.plugins:maven-shade-plugin' from the repositories [local (/home/hadoop/maven_repo), cdh.releases.repo (https://repository.cloudera.com/content/repositories/cdh-releases-rcs), cdh.snapshots.repo (https://repository.cloudera.com/content/repositories/snapshots), central (https://repo.maven.apache.org/maven2)]: Plugin not found in any plugin repository
    	at org.apache.maven.plugin.version.internal.DefaultPluginVersionResolver.selectVersion(DefaultPluginVersionResolver.java:236)
    	at org.apache.maven.plugin.version.internal.DefaultPluginVersionResolver.resolveFromRepository(DefaultPluginVersionResolver.java:148)
    	at org.apache.maven.plugin.version.internal.DefaultPluginVersionResolver.resolve(DefaultPluginVersionResolver.java:96)
    	at org.apache.maven.lifecycle.internal.LifecyclePluginResolver.resolveMissingPluginVersions(LifecyclePluginResolver.java:71)
    	at org.apache.maven.lifecycle.internal.DefaultLifecycleExecutionPlanCalculator.calculateExecutionPlan(DefaultLifecycleExecutionPlanCalculator.java:125)
    	at org.apache.maven.lifecycle.internal.DefaultLifecycleExecutionPlanCalculator.calculateExecutionPlan(DefaultLifecycleExecutionPlanCalculator.java:145)
    	at org.apache.maven.lifecycle.internal.builder.BuilderCommon.resolveBuildPlan(BuilderCommon.java:96)
    	at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:109)
    	at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
    	at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
    	at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128)
    	at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:307)
    	at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:193)
    	at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:106)
    	at org.apache.maven.cli.MavenCli.execute(MavenCli.java:863)
    	at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:288)
    	at org.apache.maven.cli.MavenCli.main(MavenCli.java:199)
    	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    	at java.lang.reflect.Method.invoke(Method.java:606)
    	at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
    	at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
    	at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
    	at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
    [ERROR] 
    [ERROR] 
    [ERROR] For more information about the errors and possible solutions, please read the following articles:
    [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginVersionResolutionException
    [hadoop@hadoop01 hadoop-2.6.0-cdh5.7.0]$

原因：检查hadoop源码根目录下面的pom.xml发现，pom并没有导入maven-shade-plugin的repository。

解决方法：添加maven-shade-plugin的repository到pom.xml

<plugin>
              <groupId>org.apache.maven.plugins</groupId>
              <artifactId>maven-shade-plugin</artifactId>
              <version>3.1.1</version>
            </plugin>

再次编译成功。