sporveien / bricker Goto Github PK

Hi!

Awesome post on Databricks blog and super timely with my own databricks project. I will almost certainly be using it! Thanks for contributing.

All of our code so far is structured steaming jobs, so the current codebase is really made up of:

a) reusable scala library with APIs for our business logic

b) lightwieght notebook as the streaming entrypoint.

Obviously for more of a interactive, data sciency use case would have a lot more code in the notebooks themselves, but for streaming these tend to be more lightweight.

So at Sporveien how do you deploy your databricks libraries? Is there another tool for this?

Also what is the Dbricks runtime 3.0 code to use for the spark version in cluster creation?

Cool exciting looking forward to using this!