Comments (6)
SSH timeouts are normal for a brief period while the instances are still coming online.
If you just wait a few minutes, do the timeouts persist or does the setup eventually continue?
from flintrock.
@nchammas thanks for replay.
After timeout. it is throwing Error:
2022-05-24 20:54:47,131 - flintrock.ssh - DEBUG - [52.201.***.***] SSH AuthenticationException.
2022-05-24 20:54:54,041 - flintrock.ssh - DEBUG - [52.201.***.***] SSH AuthenticationException.
2022-05-24 20:55:01,017 - flintrock.ssh - DEBUG - [52.201.***.***] SSH AuthenticationException.
2022-05-24 20:55:07,881 - flintrock.ssh - DEBUG - [52.201.***.***]SSH AuthenticationException.
2022-05-24 20:55:14,781 - flintrock.ssh - DEBUG - [52.201.***.***] SSH AuthenticationException.
Exception: Error reading SSH protocol banner
Traceback (most recent call last):
File "/home/satendra/decooda/NH-AWS/env/lib/python3.8/site-packages/paramiko/transport.py", line 2211, in _check_banner
buf = self.packetizer.readline(timeout)
File "/home/satendra/decooda/NH-AWS/env/lib/python3.8/site-packages/paramiko/packet.py", line 380, in readline
buf += self._read_timeout(timeout)
File "/home/satendra/decooda/NH-AWS/env/lib/python3.8/site-packages/paramiko/packet.py", line 609, in _read_timeout
raise EOFError()
EOFError
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/satendra/decooda/NH-AWS/env/lib/python3.8/site-packages/paramiko/transport.py", line 2039, in run
self._check_banner()
File "/home/satendra/decooda/NH-AWS/env/lib/python3.8/site-packages/paramiko/transport.py", line 2215, in _check_banner
raise SSHException(
paramiko.ssh_exception.SSHException: Error reading SSH protocol banner
Do you want to terminate the 2 instances created by this operation? [Y/n]: Y
Terminating instances...
52.201.***.***] SSH protocol error. Possible causes include using the wrong key file or username.
from flintrock.
SSH is working from my local machine. I tested using same pem file but cluster setup is failin with timeout.
You used the same pem file in your SSH test, but did you use the same username as in your Flintrock config?
from flintrock.
@nchammas yes, User name was same ec2-user
from flintrock.
That's weird. Can you show me all the properties of the instance you are able to SSH into? Are the subnet, security group, VPC, and AMI all the same as in your Flintrock config? Please share also the full SSH command that is working for you.
from flintrock.
@nchammas I found the issue. I was using key name in upper camel case(SparkStack.pem). That was not working with flintrock. It works for SSH.
I created new key pair called spark_stack.pem. It is working. Thank you so much for help.
from flintrock.
Related Issues (20)
- Spark 3.0.0 incompatibilities HOT 20
- Flintrock on EC2 SSH Timeout Errors HOT 6
- Sometimes describe gets the cluster name wrong HOT 4
- Wrong error message when specifying invalid AMI HOT 2
- Make Python 3 the default on launched clusters HOT 1
- Check version compatibility across Spark/Hadoop/Java and warn user when appropriate
- Timed out waiting for HDFS master to come up. HOT 3
- Upgrade to paramiko==2.7.2 HOT 1
- Issues reading S3 data on spark Cluster. HOT 11
- Authentication failure while launching cluster HOT 1
- Gracefully handle interrupted launches: allow flintrock caller to more easily idenify instances HOT 1
- Possible regression? Cluster Launch With More than 20 instances hits AWS Rate Limits HOT 4
- Possible issue in launching large number of instances and then destroying the cluster HOT 5
- New Release HOT 2
- SPARK_PUBLIC_DNS is incorrectly set when launching into a private VPC HOT 8
- get error when running "flintrock configure" command HOT 2
- Update parmaiko dependency to 2.10.1+ HOT 1
- Spark connection issue on EC2 HOT 5
- Locked out at random. Never to recover. HOT 8
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from flintrock.