Coder Social home page Coder Social logo

Comments (5)

kmandagie avatar kmandagie commented on July 24, 2024 3

For Someone in the future needed help
Add return_json_dict=true work for me

ge_data_context_root_dir_with_checkpoint_name_pass = GreatExpectationsOperator(
        task_id="ge_data_context_root_dir_with_checkpoint_name_pass",
        data_context_root_dir=ge_root_dir,
        checkpoint_name="test-checkpoint",
        return_json_dict = True,
    )

from airflow-provider-great-expectations.

kmandagie avatar kmandagie commented on July 24, 2024 1

@keerthiis : that setup works for me in airflow version 2.2.5 and version 2.3,
with this package version
great-expectations==0.15.5
airflow-provider-great-expectations==0.1.4

I don't know about other version

from airflow-provider-great-expectations.

shmf avatar shmf commented on July 24, 2024

i've faced the same issue when using GreatExpectationsOperator and pandas s3 datasource (but i'm using GCS, not S3)

from airflow-provider-great-expectations.

talagluck avatar talagluck commented on July 24, 2024

Hi - thanks for raising this issue @henriqueribeiro and @shmf ! Have you tried setting AIRFLOW__CORE__ENABLE_XCOM_PICKLING=true?

from airflow-provider-great-expectations.

keerthiis avatar keerthiis commented on July 24, 2024

@kmandagie : I am trying to use Great Expectations Operator with Postgres datasource and facing the same issue. I tried AIRFLOW__CORE__ENABLE_XCOM_PICKLING=true ( this seems to be deprecated in Airflow 2.0 )
return_json_dict = True,
None of these worked.

from airflow-provider-great-expectations.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.