Comments (16)
I can take care of this. Any preference concerning the distribution?
from apache-spark-node.
That would be great!
I'm unexperienced when it comes to dockerfiles, but my guess would be to start off from an existing spark or node dockerfile, which means going with whatever distribution that is using (likely standard ubuntu).
Does this make sense?
from apache-spark-node.
Afaik there's no official Spark image. As it has more dependencies than Node, I'd suggest to start with a Java/Ubuntu base image, and add Node.js later on.
from apache-spark-node.
Another question is what you expect to be started with the Docker image start. I guess it's bin/spark-node
? If so, the Docker container can be used interactively by supplying docker -i ...
which would then start the Spark-Node REPL...
from apache-spark-node.
Starting bin/spark-node
makes sense to me.
from apache-spark-node.
Good. I think I can finish this tomorrow.
from apache-spark-node.
I launched an automated build with the Docker Hub at https://hub.docker.com/r/tobilg/spark-node/
from apache-spark-node.
I'm assuming the "Full Description" section on the Docker Hub page doesn't automatically update with the readme from the repo? If that assumption is correct, I'd recommend changing it to a (briefer) description of the Docker image itself, with a pointer to the GitHub repo.
(Plus things like the "Requirements" section of the readme don't make sense on the Docker Hub page anyway).
from apache-spark-node.
Actually, it does auto-update. I'd suggest that you open an account yourself, then you're flexible to change it like you want.
from apache-spark-node.
Are you saying I can modify the "Full Description" on https://hub.docker.com/r/tobilg/spark-node/
? I have an account but I don't
see a way to do that.
On 27 November 2015 at 12:35, Tobi [email protected] wrote:
Actually, it does auto-update. I'd suggest that you open an account
yourself, then you're flexible to change it like you want.—
Reply to this email directly or view it on GitHub
#14 (comment)
.
from apache-spark-node.
You can only do that if you're the owner of the image. That's why I'm suggesting you should create your own image. I'll retract my image then.
from apache-spark-node.
Ah, thanks, that makes sense.
On 27 November 2015 at 13:24, Tobi [email protected] wrote:
You can only do that if you're the owner of the image. That's why I'm
suggesting you should create your own image. I'll retract my image then.—
Reply to this email directly or view it on GitHub
#14 (comment)
.
from apache-spark-node.
Created image under my docker hub account as per @tobilg's suggestion and pointed README.md to it.
from apache-spark-node.
Closing this issue. Thanks @tobilg !
from apache-spark-node.
What I noted is that I'm still stated as maintainer of the Docker image, and that the description on the Docker Hub is empty. Just to let you know...
from apache-spark-node.
Docker Hub description filled.
Re the maintainer in the Dockerfile, I left you as a way to acknowledge that you're the author.
But I could just as well put myself as maintainer and leave a comment right next to it naming you as the original author. What do you prefer?
from apache-spark-node.
Related Issues (20)
- Write up instructions for using with a notebook HOT 6
- Failure at installation HOT 2
- How to connect to s Spark Standalone Cluster? HOT 2
- Question: Is it somehow possible to use a Context and execute statements in parallel? HOT 6
- Async APIs HOT 1
- Support concurrent jobs HOT 1
- Add promise version of async functions
- Make spark-node ES7-aware
- unionAll not working? HOT 2
- Problem with spark-node HOT 4
- Failed to start spark-node with No Java runtime present error. HOT 1
- Querying a cassandra DB via spark HOT 3
- Would you like the "spark" module name on npm? HOT 3
- Streaming support from kafka ? HOT 1
- unable to install HOT 5
- Read data from mysql HOT 5
- Unable to install module with node version of 8.1.4 HOT 1
- node-gyp binding error on windows10 HOT 2
- Error with ASSEMBLY_JAR
- Let's reactivate the project?
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from apache-spark-node.