Coder Social home page Coder Social logo

Comments (5)

petedejoy avatar petedejoy commented on July 24, 2024 2

@jeffkpayne I don't have any branch in progress- we welcome community PRs if you're interested in getting involved :)

from airflow-provider-great-expectations.

Milchdealer avatar Milchdealer commented on July 24, 2024 1

Additionally, please change

credentials_path = connection_json['extra__google_cloud_platform__key_path']

to a .get() call because if you use GKE + workload identities, then the google credentials are baked in via the metadata API. I just have a dummy definition of my default connection with (almost) no values, that during the runtime is replaced by the google.auth.default() call.

from airflow-provider-great-expectations.

jeffkpayne avatar jeffkpayne commented on July 24, 2024 1

FYI, I'm working on this actively (for work) and will be opening a PR, hopefully some time next week. Just need to get setup locally per the standards of this repo.

from airflow-provider-great-expectations.

jeffkpayne avatar jeffkpayne commented on July 24, 2024

There are also other limitations related to how the data_context attribute is initialized inside __init__(). For instance, the gcp_project parameter can't be templated because it's passed into the DataContextConfig created in __init__(). Moving the data_context initialization logic into execute() would allow the other attributes to be templated, in addition to addressing the primary concerns of this issue.

from airflow-provider-great-expectations.

jeffkpayne avatar jeffkpayne commented on July 24, 2024

@petedejoy Were you planning on opening a PR to address this?

from airflow-provider-great-expectations.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.