dagster-poor-mans-data-lake's People
Forkers
opendgps basalganglia sksundaram-learning tuananh ezpzbz benpankow sabman dataspeaks2020 skanduru lenapheno alexgutierr lllong33 tangguoqiang172528725 edwardjackchandler tintinrevient mathaixdagster-poor-mans-data-lake's Issues
Error: The "distutils" standard module, which is required for the installation of Docutils, could not be found.
Both on my local machine and in a gitpod I am getting this error below. I tried to add it:
gitpod /workspace/empty/jaffle (main) $ sudo apt-get install python3-distutils
Reading package lists... Done
Building dependency tree
Reading state information... Done
python3-distutils is already the newest version (3.8.10-0ubuntu1~20.04).
0 upgraded, 0 newly installed, 0 to remove and 46 not upgraded.
But I still get the error:
INFO: pip is looking at multiple versions of packaging to determine which version is compatible with other requirements. This could take a while.
Using cached docutils-0.15.1-post1.tar.gz (1.7 MB)
Preparing metadata (setup.py) ... error
error: subprocess-exited-with-error
× python setup.py egg_info did not run successfully.
│ exit code: 1
╰─> [4 lines of output]
Error: The "distutils" standard module, which is required for the
installation of Docutils, could not be found. You may need to
install a package called "python-devel" (or similar) on your
system using your package manager.
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed
× Encountered error while generating package metadata.
╰─> See above for output.
note: This is an issue with the package mentioned above, not pip.
hint: See above for details.
run dagit AttributeError
AttributeError: module 'pendulum' has no attribute 'Pendulum'
ImportError when running on gitpod
Hi all, I have followed your Poor man data lake tutorial but encounter this error/bug when run dagit ,
ImportError: cannot import name 'introspection_query' from 'graphql' (/workspace/.pyenv_mirror/user/current/lib/python3.8/site-packages/graphql/__init__.py).
However, according to tutorial, dagster should run properly.
Are there any fixes for this? I have looked around but still not found any solutions.
Actually using AWS S3?
I have it sort of working - I am getting "something" uploaded to S3 but I am getting a multipart error. Has anyone tried to connect this to "real" S3 and what tricks do I need to know? Thanks!
error:
duckdb.Error: Invalid Error: IO Error: Unexpected response during S3 multipart upload finalization
I don't think the error is with DuckDB however, because I can connect it directly to my S3 bucket using the exact same credentials and it works just fine. I suspect it's with our hand-rolled DuckPondIOManager but I don't know how to debug it.
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.