Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

when i execute zhe storm-yarn getStormConfig command,it's happen exception. #32

Open
hackereye opened this issue Aug 2, 2013 · 3 comments

Comments

@hackereye
Copy link

[bigdata@tbe192168147047 storm-yarn]$ bin/storm-yarn getStormConfig storm.yaml --appId application_1375431632296_0002
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/bigdata/apps/hadoop-2.0.4/share/hadoop/common/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/bigdata/apps/storm-yarn/lib/storm-0.9.0-wip19/lib/logback-classic-1.0.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
13/08/02 17:00:00 INFO service.AbstractService: Service:org.apache.hadoop.yarn.client.YarnClientImpl is inited.
13/08/02 17:00:00 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
13/08/02 17:00:01 INFO service.AbstractService: Service:org.apache.hadoop.yarn.client.YarnClientImpl is started.
13/08/02 17:00:01 INFO yarn.StormOnYarn: application report for application_1375431632296_0002 :N/A:0
13/08/02 17:00:01 INFO yarn.StormOnYarn: Attaching to N/A:0 to talk to app master application_1375431632296_0002
13/08/02 17:00:01 INFO service.AbstractService: Service:org.apache.hadoop.yarn.client.YarnClientImpl is stopped.
Exception in thread "main" java.lang.IllegalArgumentException: invalid port: 0
at backtype.storm.security.auth.ThriftClient.(ThriftClient.java:37)
at com.yahoo.storm.yarn.MasterClient.(MasterClient.java:48)
at com.yahoo.storm.yarn.MasterClient.getConfiguredClient(MasterClient.java:38)
at com.yahoo.storm.yarn.StormOnYarn.getClient(StormOnYarn.java:113)
at com.yahoo.storm.yarn.StormMasterCommand.process(StormMasterCommand.java:75)
at com.yahoo.storm.yarn.Client.execute(Client.java:139)
at com.yahoo.storm.yarn.Client.main(Client.java:145)

@anfeng
Copy link
Contributor

anfeng commented Aug 2, 2013

When "storm-yarn getStormConfig" is executed immediately after "storm-yarn launch", YARN may don't have report from storm app master on its host/port. Therefore, it gets a reported port # 0.
Please wait a few seconds after "storm-yarn launch".

I have created a new pull request #33 so that storm-yarn will wait for YARN report to be ready.

d2r pushed a commit that referenced this issue Aug 2, 2013
(Issue #32) configuration setting added to wait for YARN report on app master
anfeng added a commit to anfeng/storm-yarn that referenced this issue Aug 4, 2013
@hackereye
Copy link
Author

in fact;storm-yarn launch failed ,but always can back a application id. .
2013-08-05 14:22:24,455 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Application appattempt_1375681109412_0008_000001 released container container_1375681109412_0008_01_000001 on node: host: tbe192168147049:54841 #containers=0 available=8192 used=0 with event: FINISHED
2013-08-05 14:22:24,453 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1375681109412_0008_000001 State change from LAUNCHED to FAILED
2013-08-05 14:22:24,455 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: Application application_1375681109412_0008 failed 1 times due to AM Container for appattempt_1375681109412_0008_000001 exited with exitCode: 1 due to:
.Failing this attempt.. Failing the application.
2013-08-05 14:22:24,455 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1375681109412_0008 State change from ACCEPTED to FAILED
2013-08-05 14:22:24,455 WARN org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=bigdata OPERATION=Application Finished - Failed TARGET=RMAppManager RESULT=FAILURE DESCRIPTION=App failed with state: FAILED PERMISSIONS=Application application_1375681109412_0008 failed 1 times due to AM Container for appattempt_1375681109412_0008_000001 exited with exitCode: 1 due to:
.Failing this attempt.. Failing the application. APPID=application_1375681109412_0008

@anfeng
Copy link
Contributor

anfeng commented Aug 5, 2013

I plan to merge various changes made in pull request #31 into Master soon. That should make our life easier.

For now, please try the following command to see whether you have any meaningful logs.

yarn logs -applicationId application_1375681109412_0008

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants