allenneuraldynamics / aind-data-access-api Goto Github PK
View Code? Open in Web Editor NEWLibrary to interface with AIND databases
License: MIT License
Library to interface with AIND databases
License: MIT License
As a user, I want the MongoDB client to optionally set the retryWrites to False, so I can write to AWS DocDB.
Add any helpful notes here.
As a user, I want the option to paginate read results, so I can avoid resource api gateway resource limits
Add any helpful notes here.
As a developer, I want a single repository managing our data access layer, so I can easily import the packages where they're needed.
Add any helpful notes here.
As a user, I want to retrieve schemas from the document store, so I can use them.
Maybe this isn't necessary? This can be achieved by:
doc_store_creds = DocumentStoreCredentials(aws_secrets_name="*****")
doc_store_client = DsClient(credentials=doc_store_creds, collection_name="procedures")
proc_schemas = list(doc_store_client.collection.find())
As a user, I want an api to connect to the document db, so I can read and write there.
Add any helpful notes here.
As a user, I want to be able to install doc store and rds dependencies separately, so I can have a smaller package footprint.
Add any helpful notes here.
When I try to pip install aind-data-access-api[full] s3fs
, it takes over an hour attempting to resolve dependencies, and unclear if it will finish. I suspect how we are handling boto is what makes this difficult.
As a user, I want to use the latest version of pydantic, so I can use this alongside other packages that require >=2.0
Add any helpful notes here.
As a user, I want to be able to download credentials from aws, so I don't have to manage it locally.
Add any helpful notes here.
As a user, I want write requests to be chunked, so I can write a long list of records without any errors.
Add any helpful notes here.
when I pip install, I am missing pydantic, pymongo, sqlalchemy, ...
As a user, I want to better error handlers, so I can know what went wrong with a request.
Add any helpful notes here.
As a user, I want a library to access secrets, so I can import it in other projects.
Add any helpful notes here.
As a user, I want an api to connect to the redshift db, so I can read and write there.
Add any helpful notes here.
As a db maintainer, I want a method to remove records, so I can maintain the database.
Add any helpful notes here.
As a user, I want to create a boto3 client using a session token, so I can use the api with a token instead of credentials.
Add any helpful notes here.
As a user, I want to be able to read/write from a document store, so I can process metadata stored there.
Add any helpful notes here.
As a user, I want to be able to write to a relational database, so I can build front-end apps to view the data easily.
Add any helpful notes here.
As a user, I want a method that allows me to run a generic sql query, so I can have finer control over things if I want.
Add any helpful notes here.
As a user, I want to pull from pypi, so I can easily install the package.
Add any helpful notes here.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.