Comments (11)
#48 is a pre-req to this issue
from goe.
I've partially added PBO tests:
- test_offload_pbo.py (fully added)
- test_offload_pbo_late.py (partially added)
- test_offload_pbo_intra.py (not done at all)
from goe.
offload_esoteric has been migrated to the new tests.
from goe.
Converted
- orchestration_locks.py
- orchestration_step_control.py
from goe.
Converted
- offload_part_fn.py
- offload_sorting.py
from goe.
The new todo list:
- agg_validate.py (?)
- backend_stats.py
- cli_api_nossh.py
- listener_orchestration.py
- offload_backend_part.py
- offload_full.py (we should add a hash partitioned table to this and rename
test_offload_full_part.py
) - offload_hash_bucket.py (only need the part of this relating to Synapse hash column)
- offload_list_rpa.py
- offload_lpa.py (full tests only)
- offload_pbo.py (intra day only)
- offload_subpart.py
- offload_transport.py
- schema_sync.py (?)
from goe.
Re-opening for remaining tests to be refactored.
from goe.
Only run test_offload_lpa.py::test_offload_lpa_unicode
if NLS_LANG
is set.
from goe.
Refactored offload_pbo_intra offload_lpa full.
from goe.
The new todo list:
- agg_validate.py (?)
- backend_stats.py
- cli_api_nossh.py
- listener_orchestration.py
- offload_backend_part.py
- offload_full.py (we should add a hash partitioned table to this and rename test_offload_full_part.py)
- offload_hash_bucket.py (only need the part of this relating to Synapse hash column)
- offload_subpart.py
- offload_transport.py (only the subpartition split type tests, hopefully these can become unit tests)
- schema_sync.py (?)
from goe.
Re-opening for remaining tests to be refactored.
- agg_validate.py (?)
- backend_stats.py
- cli_api_nossh.py
- listener_orchestration.py
- offload_backend_part.py
- schema_sync.py (?)
Raise issue to add a hash partitioned table to test, either to test_offload_misc.py
or new test_offload_full_part.py
. If latter then move MAXVALUE test there too.
from goe.
Related Issues (20)
- Provide option to supply GCP CMEK crypto_key_path as a single configuration item
- Add Spark fileoutputcommitter configuration to BigQuery offload template HOT 1
- Consider support for BigQuery INTERVAL when offloading Oracle INTERVAL YM and DS
- Prototype Google Cloud Run procedure
- Convert offload.env file to a config file
- Review sampling of BIGINTs in Oracle NUMBER columns
- Implement sub-chunking for offloads
- Bump release to v1.0.4 HOT 1
- Better default partition granularity on BigQuery HOT 1
- Tests to support OFFLOAD_LOGDIR on GCS
- Consider time zone in BigQuery job config
- Release v1.0.5 HOT 1
- OffloadTransportSparkDataprocGcloudCanary exception
- Document recommended GCP roles and privileges
- Publish releases to PyPi
- User Guide
- Release 1.0.6
- Can version file be removed
- Add test for table with accented column name
- Verify exported data step in preview mode appears to still be executing Oracle SQL
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from goe.