brainpad / cliboa Goto Github PK
View Code? Open in Web Editor NEWapplication framework for ETL(ELT) pipeline, process
License: MIT License
application framework for ETL(ELT) pipeline, process
License: MIT License
remove .project
add .gitignore
Rename BigQueryReadCache to BigQueryRead
Currently every single columns must be defined.
Add a parameter and allow to change only defined columns.
SUCCESSFUL_TERMINATION = 0
ABNORMAL_TERMINATION = 1
add flake8, autoflake, isort
Unittest codes are not available., so fix them.
There is no source file loading functionalities, so add them.
cliboadmin should support functionality to create conf/logging.conf
Must get resource from Client if credentials is none
Create a class which changes local file name.
Now circle ci test cases are not available.
Rename CsvReadBigQueryCreate to BigQueryWrite
Currently Cliboa does not return any response code
Rename CsvColsExtract to CsvColumnDelete and add functionalities
Fix Pipfile for each versions, Pipfile.above34, Pipfile.above35, Pipfile.above37
cliboadmin controls these files.
Make bulk insert count to one of the arguments in BigQueryWrite, since google api will be error if a plenty of requests occurred.
・Transform
If output destination was defined, new file will be created, if not input file will be replaced with transformed file.
Now AWS access_key and secret_key are shown in app.log, so mask them.
paramiko/paramiko#1369
need to be fixed
Rename GcsFileUplaod to GcsUpload.
Now default delimiter in S3Download is "/". Modify "/" to None.
The current logging functionality does not support multiprocessing.
Not always necessary setter/getter.
Remove getter properties but remains setter properties.
add mysql wrapper class
Currently ExtractJobConfig always creates csv headers. Add header option to ExtractJobConfig.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.