rails-on-services / ros Goto Github PK

View Code? Open in Web Editor NEW

4.0 4.0 5.0 1.97 MB

Ruby 97.09% Shell 0.02% JavaScript 0.11% CSS 0.11% HTML 2.20% Python 0.47%

ros's People

Contributors

Stargazers

Watchers

Forkers

rpbaltazar kostyaplis alexeylightit peterhoeg johndpope

ros's Issues

storage: localstack as backend for ActiveSupport is misconfigured

Further to #223

In development mode, the storage service should be using localstack instead of aws.

However, the current config is invalid causing the tenant after_commit hook to fail.

Cc: @rpbaltazar

Support custom transfer_map to be sent for a specific file upload

The API consumer would send us a transfer_map specification for a specific file upload. This way we can dynamically parse the file on the BE.

Add action cable support

Using action cable to give progress feedback to the front end is something that might come in handy in the near future.
e.g. Provide active feedback when a file has finished to be processed (transactions or user upload,....)

This should be part of the comm service for now

Support custom field in transfer_map with property name

as part of the transfer_map, there should be an attribute for custom that supports a key to store the values in user properties.

e.g.
CSV File headers:
Name, Family Name, Favorite color

the transfer_map would be:
name -> first_name
family name -> last_name
favorite color -> custom, key: 'color'

This would then create a user with the properties: { color: }

Ensure the IAM user is able to get/create transfer maps

For the advanced upload we need to expose the transfer maps for the audience so the users can update those on the fly/file basis

If this is already possible to do, document it in Confluence

Allow saving the transfer map as a new default for the user

This would either store a new transfer map or replace the existing one (depending on our current relationship).

Support hostnames that don't necessarily match the service name

Each service should be able to have its own individual configuration.
Revisit: https://github.com/rails-on-services/ros/blob/master/lib/sdk/lib/ros_sdk/sdk.rb#L71-L92

problem is caused by services that have 2 names and are currently forced to follow a pattern that Is not always the wanted one.

NOTE: The SDK currently assumes that the host name is a derivative of the module name in which the service's client is declared which is fine for a default but should be configurable

As soon as we include the record count, JSON API applies filters twice

JSONAPI.configure do |config|
          # http://jsonapi-resources.com/v0.9/guide/resource_caching.html
          config.resource_cache = Rails.cache
          #:underscored_key, :camelized_key, :dasherized_key, or custom
          config.json_key_format = :underscored_key
          #:underscored_route, :camelized_route, :dasherized_route, or custom
          config.route_format = :underscored_route

          config.default_paginator = :none
          # config.default_page_size = 10
          # config.maximum_page_size = 20
          config.top_level_meta_include_record_count = true
          config.top_level_meta_record_count_key = :record_count
          # config.top_level_meta_include_page_count = true
          # config.top_level_meta_page_count_key = :page_count
        end

core: workers in test are using the same queues as development

Running the test suite will create a number of jobs in the development redis queues which are then picked up for execution by the dev environment.

We should either use a dummy/mocked redis or at the very least different queue names to avoid overlap.

Deprecation warning when running ros

vagrant@ros-dev:~/ros-dev/whistler-services$ ros be test loyalty
fatal: Not a git repository (or any parent up to mount point /home/rails/lib)
Stopping at filesystem boundary (GIT_DISCOVERY_ACROSS_FILESYSTEM not set).
fatal: Not a git repository (or any parent up to mount point /home/rails/lib)
Stopping at filesystem boundary (GIT_DISCOVERY_ACROSS_FILESYSTEM not set).
fatal: Not a git repository (or any parent up to mount point /home/rails/lib)
Stopping at filesystem boundary (GIT_DISCOVERY_ACROSS_FILESYSTEM not set).
DEPRECATION WARNING: `Module#parent` has been renamed to `module_parent`. `parent` is deprecated and will be removed in Rails 6.1. (called from configure at /home/rails/ros/lib/sdk/lib/ros_sdk/sdk.rb:70)
DEPRECATION WARNING: `Module#parent` has been renamed to `module_parent`. `parent` is deprecated and will be removed in Rails 6.1. (called from configure at /home/rails/ros/lib/sdk/lib/ros_sdk/sdk.rb:72)
DEPRECATION WARNING: `Module#parent` has been renamed to `module_parent`. `parent` is deprecated and will be removed in Rails 6.1. (called from configure at /home/rails/ros/lib/sdk/lib/ros_sdk/sdk.rb:73)
DEPRECATION WARNING: `Module#parent` has been renamed to `module_parent`. `parent` is deprecated and will be removed in Rails 6.1. (called from configure at /home/rails/ros/lib/sdk/lib/ros_sdk/sdk.rb:74)
DEPRECATION WARNING: `Module#parent` has been renamed to `module_parent`. `parent` is deprecated and will be removed in Rails 6.1. (called from configure at /home/rails/ros/lib/sdk/lib/ros_sdk/sdk.rb:70)
DEPRECATION WARNING: `Module#parent` has been renamed to `module_parent`. `parent` is deprecated and will be removed in Rails 6.1. (called from configure at /home/rails/ros/lib/sdk/lib/ros_sdk/sdk.rb:72)
DEPRECATION WARNING: `Module#parent` has been renamed to `module_parent`. `parent` is deprecated and will be removed in Rails 6.1. (called from configure at /home/rails/ros/lib/sdk/lib/ros_sdk/sdk.rb:73)
DEPRECATION WARNING: `Module#parent` has been renamed to `module_parent`. `parent` is deprecated and will be removed in Rails 6.1. (called from configure at /home/rails/ros/lib/sdk/lib/ros_sdk/sdk.rb:74)
DEPRECATION WARNING: `Module#parent` has been renamed to `module_parent`. `parent` is deprecated and will be removed in Rails 6.1. (called from configure at /home/rails/ros/lib/sdk/lib/ros_sdk/sdk.rb:70)
DEPRECATION WARNING: `Module#parent` has been renamed to `module_parent`. `parent` is deprecated and will be removed in Rails 6.1. (called from configure at /home/rails/ros/lib/sdk/lib/ros_sdk/sdk.rb:72)
DEPRECATION WARNING: `Module#parent` has been renamed to `module_parent`. `parent` is deprecated and will be removed in Rails 6.1. (called from configure at /home/rails/ros/lib/sdk/lib/ros_sdk/sdk.rb:73)
DEPRECATION WARNING: `Module#parent` has been renamed to `module_parent`. `parent` is deprecated and will be removed in Rails 6.1. (called from configure at /home/rails/ros/lib/sdk/lib/ros_sdk/sdk.rb:74)
DEPRECATION WARNING: `Module#parent` has been renamed to `module_parent`. `parent` is deprecated and will be removed in Rails 6.1. (called from configure at /home/rails/ros/lib/sdk/lib/ros_sdk/sdk.rb:70)
DEPRECATION WARNING: `Module#parent` has been renamed to `module_parent`. `parent` is deprecated and will be removed in Rails 6.1. (called from configure at /home/rails/ros/lib/sdk/lib/ros_sdk/sdk.rb:72)
DEPRECATION WARNING: `Module#parent` has been renamed to `module_parent`. `parent` is deprecated and will be removed in Rails 6.1. (called from configure at /home/rails/ros/lib/sdk/lib/ros_sdk/sdk.rb:73)
DEPRECATION WARNING: `Module#parent` has been renamed to `module_parent`. `parent` is deprecated and will be removed in Rails 6.1. (called from configure at /home/rails/ros/lib/sdk/lib/ros_sdk/sdk.rb:74)
DEPRECATION WARNING: `Module#parent` has been renamed to `module_parent`. `parent` is deprecated and will be removed in Rails 6.1. (called from configure at /home/rails/ros/lib/sdk/lib/ros_sdk/sdk.rb:70)
DEPRECATION WARNING: `Module#parent` has been renamed to `module_parent`. `parent` is deprecated and will be removed in Rails 6.1. (called from configure at /home/rails/ros/lib/sdk/lib/ros_sdk/sdk.rb:72)
DEPRECATION WARNING: `Module#parent` has been renamed to `module_parent`. `parent` is deprecated and will be removed in Rails 6.1. (called from configure at /home/rails/ros/lib/sdk/lib/ros_sdk/sdk.rb:73)
DEPRECATION WARNING: `Module#parent` has been renamed to `module_parent`. `parent` is deprecated and will be removed in Rails 6.1. (called from configure at /home/rails/ros/lib/sdk/lib/ros_sdk/sdk.rb:74)
DEPRECATION WARNING: `Module#parent` has been renamed to `module_parent`. `parent` is deprecated and will be removed in Rails 6.1. (called from configure at /home/rails/ros/lib/sdk/lib/ros_sdk/sdk.rb:70)
DEPRECATION WARNING: `Module#parent` has been renamed to `module_parent`. `parent` is deprecated and will be removed in Rails 6.1. (called from configure at /home/rails/ros/lib/sdk/lib/ros_sdk/sdk.rb:72)
DEPRECATION WARNING: `Module#parent` has been renamed to `module_parent`. `parent` is deprecated and will be removed in Rails 6.1. (called from configure at /home/rails/ros/lib/sdk/lib/ros_sdk/sdk.rb:73)
DEPRECATION WARNING: `Module#parent` has been renamed to `module_parent`. `parent` is deprecated and will be removed in Rails 6.1. (called from configure at /home/rails/ros/lib/sdk/lib/ros_sdk/sdk.rb:74)
DEPRECATION WARNING: `Module#parent` has been renamed to `module_parent`. `parent` is deprecated and will be removed in Rails 6.1. (called from configure at /home/rails/ros/lib/sdk/lib/ros_sdk/sdk.rb:70)
DEPRECATION WARNING: `Module#parent` has been renamed to `module_parent`. `parent` is deprecated and will be removed in Rails 6.1. (called from configure at /home/rails/ros/lib/sdk/lib/ros_sdk/sdk.rb:72)
DEPRECATION WARNING: `Module#parent` has been renamed to `module_parent`. `parent` is deprecated and will be removed in Rails 6.1. (called from configure at /home/rails/ros/lib/sdk/lib/ros_sdk/sdk.rb:73)
DEPRECATION WARNING: `Module#parent` has been renamed to `module_parent`. `parent` is deprecated and will be removed in Rails 6.1. (called from configure at /home/rails/ros/lib/sdk/lib/ros_sdk/sdk.rb:74)
DEPRECATION WARNING: `Module#parent` has been renamed to `module_parent`. `parent` is deprecated and will be removed in Rails 6.1. (called from configure at /home/rails/ros/lib/sdk/lib/ros_sdk/sdk.rb:70)
DEPRECATION WARNING: `Module#parent` has been renamed to `module_parent`. `parent` is deprecated and will be removed in Rails 6.1. (called from configure at /home/rails/ros/lib/sdk/lib/ros_sdk/sdk.rb:72)
DEPRECATION WARNING: `Module#parent` has been renamed to `module_parent`. `parent` is deprecated and will be removed in Rails 6.1. (called from configure at /home/rails/ros/lib/sdk/lib/ros_sdk/sdk.rb:73)
DEPRECATION WARNING: `Module#parent` has been renamed to `module_parent`. `parent` is deprecated and will be removed in Rails 6.1. (called from configure at /home/rails/ros/lib/sdk/lib/ros_sdk/sdk.rb:74)
DEPRECATION WARNING: Initialization autoloaded the constants ApiBelongsTo, Ros::ApplicationRecordConcern, ApplicationRecord, Ros::TenantConcern, and Tenant.

Audience upload broken

When we try to update an audience file, the processing status is not being updated accordingly

For associations where we expect only one record, if there are multiple, then we should raise an error

E.g. Has One Resource assumes that there is only one associate resource. If for some reason the data got out of sync, we'd be happily filtering out other results instead of explaining that there are inconsistent data.

Recommend Projects

React

A declarative, efficient, and flexible JavaScript library for building user interfaces.
Vue.js

🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
TensorFlow

An Open Source Machine Learning Framework for Everyone
Django

The Web framework for perfectionists with deadlines.
Laravel

A PHP framework for web artisans
D3

Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

javascript

JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
web

Some thing interesting about web. New door for the world.
server

A server is a program made to process requests and deliver data to clients.
Machine learning

Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Visualization

Some thing interesting about visualization, use data art
Game

Some thing interesting about game, make everyone happy.

Recommend Org

Facebook

We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft

Open source projects and samples from Microsoft.
Google

Google ❤️ Open Source for everyone.
Alibaba

Alibaba Open Source for everyone
D3

Data-Driven Documents codes.
Tencent

China tencent open source team.