nmsa / tma-framework-m

Component M - Trustworthiness Monitoring & Assessment Framework

Hi, I’m Nuno,

I am a 38-year-old software engineer working on the development of AppSweep at Guardsquare.

Since 2007, I have been researching, developing and teaching software security, dependability, and reliability engineering.

My research has been helping software engineers to create secure systems through automated tools to find vulnerabilities and attacks, and also by proposing benchmarking approaches to select the best alternatives for their use.

I am expert in code reviews, testing, static analysis, fault injection, vulnerability injection and benchmarking, that I have applied over the years in the assessment of the security and dependability of web and mobile applications, web services, intrusion detection systems, virtualized environments, intelligent systems, and data management systems.

I have applied these techniques in the industry through specialized services, collaboration in international consortia or during secondments of industry-academia projects.

I am always interested in the behavior of technologies used in business-critical scenarios in the presence of attacks and faults. I keep an eye on newly reported vulnerabilities and incidents and I study the advantages/disadvantages that each new famous language/framework brings in terms of security.

• 📫 Reach me at [email protected]

tma-framework-m's Issues

Create Apache Kafka Dockerfile

Move Kafka configurations for a folder with the respective Dockerfile to ease the deployment.

Document Java client components

Document Java Components:

• Java library: monitor-client
• Java demo probe: probe-demo

Fix dependency problems in Monitor Client

The maven plugins shade or assembly cause that some of the dependencies
start working incorrectly (see error below).
The solution is to add transformers to better handle the manifests.

Error:
SEVERE: MessageBodyWriter not found for media type=application/json, type=class eu.atmosphere.tmaf.monitor.message.Message, genericType=class eu.atmosphere.tmaf.monitor.message.Message.

Create Yaml files for Kubernetes

Creation of Yaml files to deploy python probe (developed in #25), in kubernetes.

MySQL storage

After #11, #13

• Define datamodel / crebas.sql
• Create example data

Create REST API

• select framework to use
• start Dockerfile with framework and configurations
• define main endpoints

Demo Java Probe

After #5

Demonstration probe using Java client library.
Should submit periodically example data (possibly random).

Similar to #7

Integrate Flume with the new datamodel

Related with the data necessary for #14

Implement Confidentiality and Integrity Mechanisms in Apache Kafka

Implementation of mechanisms that ensure confidentiality and integrity of messages forwarded by Apache Kafka.

Python Client Library

Python client library for communication with monitor, for quick development of python-based probes.

REST API integration with Apache Kafka e Apache Flume

After #1
These components will be deployed and integrated using Kubernetes.
API REST will be deployed in one Kubernetes pod, Apache Kafka in second, and Apache Flume will be deployed in the third pod.

Correct minimum element restrictions in schema

The current schema allows for empty arrays (e.g. observations).

Add nodeport to the monitor service

Monitor Testing Mode Instructions in Wiki

@rfrsilva, please add/link the config instructions in the wiki:
https://github.com/eubr-atmosphere/tma-framework/wiki/Deploy-a-testing-mode-TMA-Monitor-in-kubernetes

Create a C# Monitor Client Library

C# libraries are necessary to integrate with our partners in the next steps.

Add TLS to the Rest API

Add TLS to the API developed in #1.
Check flask capabilities to support this.

@rfrsilva Todo complete description

Demo Python probe

After #6

Demonstration probe using Python client library.
Should submit periodically example data (possibly random).

Similar to #8

Document server component

Document the server component, including:

• Server configuration instructions
• Server component deployment instructions
• Rest API description
• Rest API usage

MySQL Integration with Apache Flume

After #11

• Create MySQL Docker file
• Add MySQL Docket to compose file
• Configure Flume to write to MySQL

Java Client Library

Java client library for communication with monitor, for quick development of java-based probes.

Demonstration of the existing features

Prepare a video (or slides) of:

• Monitor deployment
• Client usage
• Probe development
• Containers metrics reported

Slides available at: tma-framework/documents/ATMOSPHERE_TMA_Framework_usage.pdf

Create tool to input Design-time data

As described in the TMA Framework:

The platform also receives the results of the design-time assessment tasks, in which the performance and scalability requirements are not so stringent. The tools used to perform these assessment tasks are able to push data through the ReceiveData interface. When this not possible, adapters are used to transform the output of the tools and submit it to the platform. In some cases these results may have to be added manually, through a supporting tool.

Monitor Instructions in Wiki

@rfrsilva, please add/link the config instructions in the wiki:
https://github.com/eubr-atmosphere/tma-framework/wiki/Deploy-TMA-Monitor-in-Kubernetes

Create generic Java Application Server probe

This probe should be generic enough to work in several App Servers.

Can be demonstrated in:

• WildFly
• GlassFish
• other lighter solutions

Integrate Authentication

After #1

• Integrate with FogBow Authentication Service
• Manage tokens

REST API Message Format Validation

After #1 .
Validate messages against TMA Monitor Schema.

Integration with CloudEA

Add certificate to probe libraries/images

Add network monitoring functionalities to Kubernetes

Improve the probe implemented in #26 to monitor network based on kubernetes API.

Create Python Probe Dockerfile

Move Python probe code files to Dockerfile for easy deployment.

Document development structure and process

Document the development process

• Development components
• Development of java components

Document the development structure

• development
• • dependency
• • libraries
• • probes
• • server
• • test

Add Script to Automate Probe-k8s-Network Deployment

Bash script to automates:

• Copy the Node Exporter into pods;

• Execute the Node Exporter into pods;

• Deployment of Prometheus files in Kubernetes;

• Deployment of probe-k8s-network.

REST API Testing Mode

After #1, #3, #11
Include an operation mode of REST API without storage.
Should be able to test JSON files against schema, enqueue in Kafka, process in Flume, and dump them on a log file.

Create Docker Image for Probe Kubernetes Metrics

Create base Docker image for probe Kubernetes Metrics with the same structure of the other existing probes.