tobischw / ecs-instance-type-selector

Easily find cheapest AWS configurations and cluster pricing rates, in many different configurations. Written in Elm. SIUE Senior Project.

ecs-instance-type-selector

Easily calculate AWS cluster pricing rates, in many different configurations. Written in Elm.

How to build/run

• First, ensure you have Elm installed.
• Next, git clone the master branch and cd into it.
• Make sure you install create-elm-app by doing npm i create-elm-app -g
• From there, run elm-app start to start the app.

ecs-instance-type-selector's Issues

Start progress on UI mockup for Nathan

We should seriously start looking into best ways to visualize this project to the user. Not only does this include the discussed "tree view"/"bin packing" diagrams suggested by @nathantippy, but also general user experience.

Few questions to consider answering:

• Services and Tasks input
• CPU/IO/Memory as sliders/dropdowns/radios etc...
• Complexity of options - when to hide and when to show
• Besides visualization, how do we display final configuration? List/table/gallery/etc?
• UX on how to save progress - localStorage or download JSON etc...

Ability to delete cluster/services/containers

Little tricky, but doable (with the lookup technique).

Make all the editable items renamable

Fix minimum memory and scaling step

During our discussion with Nathan on 4/8 we asked him about the minimum container memory. We currently have it set to 250Mb which he said was way to big.

He said he has seen containers running DSL(Damn Small Linux) only running on a bout 16Mb of RAM, and he said he has also seen lots of containers in the 32-64Mb range, so we need to rethink again how that slider works. We need a way to have totally different memory scalings. I almost think we might need to do the drop-down range idea. Where I dropdown sets the min/max/step of the memory slider.

Figure out UI framework for Elm

We have to find out what UI framework we'd like to go with for the project.

Candidates include:

• mdgriffith/elm-ui
• Plain old Bootstrap CSS

Split up and fix Elm markup

Understand AWS API and integrate with Elm

Goal: Receive a list of AWS EC2 products in Elm and render to browser

Place regions selector in correct configuration item

Multi-select works, but you cannot dismiss the dropdown by clicking away. This requires subscriptions to be hooked up into the Task.elm file.

Add nominal tasks count

Enter event in New Service modal causes site refresh

See title.

Understand optimization problem and look at literature/research for algorithms

This is the core of the project and requires thorough research. Naturally, not every algorithm or solution will be able to cover the scope of the entire feature set, but should be good enough for a MVP.

Some general things I've found and think we should investigate:

• Multiple Constraints Knapsack problem
• General Overview of Packing Problem
• Reddit User trying to do something similar with pokersets in Elm
• Bin Packing Heuristic

Shrink the results width

Fix minimum bandwidth

Show pricing from API data

Determine branching strategy

Fix relative path issue

With the newest tobi-dev and will-dev, containers are viewed using container/{serviceId}/{containerId}. However, all of the resource and url linking is done relative, so when you are viewing a container, the links break, due to only using ../testlink. This needs to be fixed somehow, but is not a super-high priority.

Disable IOOPS slider hiding from EBS

Add daemon tasks per container instance

Sidebar should offer functionality to add and remove items (containers, tasks, services) and highlight active link

Add packing strategy field to service/tasks setting

As discussed with @nathantippy

Investigate possibility of elm-ui instead of bootstrap

As a user I want to be able to attach tasks to services in my cluster

AWS API is returning no results

Related to #61
This is also related to elm-aws-testbed.

The API must have changed in the meantime, ensure we use updated apiVersion and double-check access keys. Update the AWS SDK if required.

Add active link highlighting to the selected configuration item

Make the selected item in the tree view thing blue or something when it is selected. This indicated to the user which item is currently selected & visible

Add min/max in task settings

As discussed with @nathantippy

We want the ability to set minimum tasks for scaling (at least 1) to a maximum for scaling to take care of in the algorithm.

Setup Project Formatting in VSCode

Since we will be using differing formatters for elm, we can setup a formatter for the workspace(For Emmet and I) and Tobi can setup a personal formatter for his local vscode config.

Then we need to setup a formatter that runs on commit so all of our code on the remote is in a consistent style.

Add visualization

Replace storage slider with network slider

When adding containers, users should be able to give them a name

Better ID assignment

If you add containers with id 0 1 2 and delete id 0, and then add a new container, that one gets id 2, replacing the other one

Sum container requirements within task

Sum all of the containers requirements so that the user can get an overview of the total resources needed per task

Integrate playground AWS API/ports with current project

This will be necessary in the future, since we are slowly working our way towards the optimization problem...

There are a couple things to keep in mind here:

• The playground itself uses create-elm-app, so do we want to integrate it using the .map approach as we have been doing, or do we want the API to not be aware of any state and just return a list of instances? The latter approach may require some refactor of the playground but probably cleaner and easier to work with.

• Pricing data parsing still does not work, see #12.

• We may want to create an "intermediary" API, so that our life in the optimization phase will be easier. The reason for this is because the actual API/JSON structure we get back from the AWS API is a total mess and not pretty to work with in Elm.
  For example, we would turn this mess:

type alias ProductsResponse =
    { formatVersion : String
    , priceList : List PriceListing -- Since the repsonse is weird, the ProductList is necessary as an intermediary
    , nextToken : String
    }


type alias PriceListing =
    { product : Product
    , serviceCode : String
    , terms : PricingData
    , version : String
    }

type alias PricingData =
    {
        offerTermCode : String
        , effectiveDate : String
    }    

...

...into something simpler like this:

type alias Instances = List Instance

type alias Instance {
    name : String
   , instanceType : String
   , pricePerHour : Float
   , memory : Int
   , ioops : Int
   , usesEBS : Bool
   , networkBandwidth : Int
   , region : Region
}

This will make the optimization MUCH easier, so something to consider.

For containers overview, multiply data points by number of tasks

Add "Allow EBS" boolean checkbox for container

Scroll View

The service view should be scroll able in case of many services.

Modify memory slider to be more user-friendly

As discussed with @nathantippy and @Ragex04

Remove delete option for cluster

Since we only have one top-level cluster, we really don't need the "remove cluster" (trashcan) option for it. If a user currently does delete a cluster, there's no way to add another one to it.

Setup project structure

• Create elm-app
• Pull in bootstrap

Introduce concept of "Cluster" and make "Service" children of cluster

This is a big one. Will require some fundamental model rewrites. We know how to write this code but it's not pretty, so please see #41 first.

Set up routing in project to handle users clicking on a task/service etc

Some good docs that ere found:

• https://elm.christmas/2018/15
• https://guide.elm-lang.org/webapps/navigation.html

As a user I want to be able to create a service for my cluster

Determine best approaches for visualization

Clean-up nested update logic

Code is a bit messy for this. Needs to be cleaned up, optimized, and/or broken into multiple functions (if possible).

Re-add icons

As a user I want to be able to select the region.

Setup basic Elm layout

Fix max task being lower than min tasks

Add the ability to add tasks

Add export/import functionality

Using JSON decoders/encoders to export configuration. Make sure we do this after we settle on final forms

Write export/import JSON decoders for configuration