This repository contains Real Time Data Ingestion Platform SDK functions and documentation. This README will be a developer guide to understand the repository.
โโReal Time Data Ingestion Platform (RTDIP) SDK is a python software development kit built to provide users, data scientists and developers with the ability to interact with components of the Real Time Data Ingestion Platform, including:
- Building, Executing and Deploying Ingestion Pipelines
- Execution of queries on RTDIP data
- Authentication to securely interact with environments and data
See RTDIP Documentation for more information on how to use the SDK.
Folder Name | Description |
---|---|
.github/workflows |
yml files for Github Action workflows |
.devcontainer |
Setup for VS Code Remote Containers and Github Spaces |
docs |
Documentation in markdown, organised by subject name at folder level |
src |
Main projects and all souce code, organised by language and sdk name |
tests |
Test projects and unit tests, organised by language and sdk name |
File Name | Description |
---|---|
mkdocs.yml |
yml file to host all documentation on mkdocs |
setup.py |
Set up requirements for python package deployment |
environment.yml |
yml file to create an environment with all the dependencies for developers |
CODE_OF_CONDUCT |
code of conduct |
CODEOWNERS |
codeowners |
CONTRIBUTING.yml |
contributing |
GOVERNANCE.yml |
governance |
LICENSE.yml |
license |
RELEASE.yml |
releases |
SUPPORT.yml |
support |
PYPI-README.yml |
PyPi read me documentation |
README.yml |
RTDIP read me documentation |
.gitignore |
Informs Git which files to ignore when committing your project to the GitHub repository |
- To get started with developing for this project, clone the repository.
git clone https://github.com/rtdip/core.git
-
Open the respository in VS Code, Visual Studio or your preferered code editor.
-
Create a new environment using the following command:
conda env create -f environment.yml
NOTE: You will need to have conda, python and pip installed to use the command above.
- Activate your newly set up environment using the following command:
conda activate rtdip-sdk
You are now ready to start developing your own functions. Please remember to follow RTDIP's development lifecycle to maintain clarity and efficiency for a fully robust self serving platform.
-
Develop
-
Write unit tests
-
Document
-
Publish
NOTE: Ensure you have read the Release Guidelines before publishing your code.
This project welcomes contributions and suggestions. If you have a suggestion that would make this better you can simply open an issue with a relevant title. Don't forget to give the project a star! Thanks again!
For more details on contributing to this repository, see the Contibuting Guide. Please read this projects Code of Conduct before contributing.
This repository has been configured with support documentation for Real Time Data Ingestion Platform (RTDIP) to make it easier to get started. RTDIP's documentation is created using mkdocs and is hosted on Github Pages.
- Documentation can be found on RTDIP Documentation
Distributed under the Apache License Version 2.0. See LICENSE.md for more information.
- For reference documentation, pre-requisites, getting started, tutorials and examples visit RTDIP Documentation.
- File an issue via Github Issues.
- Check previous questions and answers or ask new ones on our slack channel #real-time-data-ingestion-platform
- Chat with other community members by joining the #real-time-data-ingestion-platform Slack channel. Click here to join our slack community