cloudslab / cloudsimsdn

CloudSimSDN is an SDN extension of CloudSim project to simulate Networking, SDN and SFC features in the context of edge and cloud data centers.

CloudSimSDN

CloudSimSDN: SDN extension of CloudSim project. Version 2.0 (CloudSimSDN-NFV) is now availalbe.

New Features:

• Resource provisioning for NFV in the edge computing environment;
• Simulation framework for NFV in edge and cloud computing (inter cloud data centers);
• Policy supports of Network link selection, VM allocation, Virtual Network Function(VNF) placement, and SFC auto-scaling algorithms;
• Performance evaluation of the framework with use case scenarios.

Introduction

CloudSimSDN is to simulate utilization of hosts and networks, and response time of requests in SDN-enabled cloud data centers. CloudSimSDN is an add-on package to CloudSim, thus it is highly recommended to learn how to use CloudSim before using CloudSimSDN. CloudSimSDN supports calculating power consumption by both hosts and switches. For instance, network-aware VM placement policies can be evaluated using CloudSimSDN. As an example, we will present energy savings in SDN-enabled cloud data center via VM consolidation. If VMs are consolidated to the minimum number of hosts, the unused hosts and switches can be powered off to save more power. We will show two different VM placement policies: Best Fit (MFF, Most Full First) and Worst Fit (LFF, Least Full First).

Program Dependencies📄

You need to integrate CloudSim with CloudSimSDN. There are two ways to include CloudSim into the project: (1) including the CloudSim Source code; (2) importing the CloudSim jar.

Method1: including the CloudSim Source Code

In order to integrate the CloudSim src code, download CloudSim source code from (https://github.com/Cloudslab/cloudsim), then copy the CloudSim src code (\cloudsim-master\modules\cloudsim\src\main) into (\cloudsimsdn-master\src\main). For the dependency of opencsv used in the container module of CloudSim, include the dependency in the pom.xml:

<dependency>
        <groupId>com.opencsv</groupId>
        <artifactId>opencsv</artifactId>
        <version>3.7</version>
</dependency>

Method2: importing the CloudSim jar

1. You need download or clone CloudSim and export the jar of the newest version (bugs fixed to support cloudsimsdn-nfv), name it (cloudsim-4.0.jar);
2. Add generated cloudsim-4.0.jar local jar into the maven dependencies: add the cloudsim dependency in pom.xml.

        <dependency>
            <groupId>org.cloudbus.cloudsim</groupId>
            <artifactId>cloudsim</artifactId>
            <version>4.0</version>
            <scope>system</scope>
    	    <systemPath>${project.basedir}/YOUR_PATH/cloudsim-4.0.jar</systemPath>
        </dependency>

3. enter the project's root directory and execute mvn clean install to install the jar packages into your local maven repository.

Other dependencies are already included.

Quick Start⚡️

After the mvn build, you could simply run the project's example in IDE's Run Configurations by adding commands in the Arguments:

• For example, to start the simulation example of SimpleExampleInterCloud:

LFF example-intercloud/intercloud.physical.json example-intercloud/intercloud.virtual.json example-intercloud/intercloud-example-workload.csv example-intercloud/intercloud-example-workload2.csv

• To run StartExperimentSFCEdge:

LFF 0 example-edge/edge.physical.json example-edge/edge.virtual.json example-edge/ edge.workload_host1.csv edge.workload_host2.csv

• To run StartExperimentSFC: 1 for enable SFC auto-scaling

LFF 1 example-sfc/sfc-example-physical.json example-sfc/sfc-example-scale-virtual.json example-sfc/ sfc-example-scale-workload.csv

Package Components

1. org.cloudbus.cloudsim.sdn

Main components of CloudSimSDN. Core functions are implemented in this package source codes.

2. org.cloudbus.cloudsim.example

Example program. SimpleExample.java is the entry point of the example program. Please follow the code from SimpleExample.java This document is to describe the example program. Other Scenarios includes: Inter cloud data centers, Link Selection Policy, Overbooking Host Resources, QoS, Service Function Chaining, and Service Function Chaining in edge computing.

3. org.cloudbus.cloudsim.sdn.exmaple.topogenerators

Example topology generators. Physical / Virtual topology files (inter-clouds, Edge computing, SFC, multi-tier web application, etc.) can be generated by using these generators with customizable parameters. Some distributions can be used within topology generators.

4. org.cloudbus.cloudsim.sdn.monitor

Energy consumption and utilization monitor.

5. org.cloudbus.cloudsim.sdn.nos

Main components of Networking Operation System includes flow channel manager, and extended version of nos for different scenarios.

6. org.cloudbus.cloudsim.sdn.parsers

Parsers for physical topology, virtual topology, and workload.

7. org.cloudbus.cloudsim.sdn.physicalcomponents

SDN-enabled components includes node, link, physical topology, switches (Aggregation, core, edge, gateway, inter-cloud), routing table, extended datacenter, and host.

8. org.cloudbus.cloudsim.sdn.policies

Policies (algorithms) for Host selection, Link selection, Vm allocation, Host overbooking.

9. org.cloudbus.cloudsim.sdn.provisioners

Bandwidth(bw) and CPU(Pe) overbooking provisioners.

10. org.cloudbus.cloudsim.sdn.sfc

Main components of Service Function Chaining (SFC) festures, including SFC Forwarder, SFC policy, auto scaling algorihtms (scaling up and out), etc.

11. org.cloudbus.cloudsim.sdn.virtualcomponents

Flows created in VMs (SDNVM.java) through channel(Channel.java) based on corresponding Flow configuration(FlowConfig.java) are forwarded according to rules(ForwardingRule.java) in SDN-enabled switches. VirtualNetworkMapper includes the main APIs for network traffic forwarding.

12. org.cloudbus.cloudsim.sdn.workload

Core components for workload processing and networking transmission. Request.java represents the message submitted to VM that includes a list of activities(Activity.java) that should be performed at the VM (Processing and Transmission). Furthermore, in some senarios, one request could include another request for the subsequent requests which will be performed at the other VMs.

Input Data

We need to submit three input files to CloudSimSDN: data center configuration (physical topology), resource deployment request (virtual topology), and workloads for VMs.

Physical topology (Data center configuration)

Configurations of physical hosts, switches and links that consist of SDN-enabled cloud data center. This can input as JSON file. Please look at sdn-example-physical.json file. In this example, data center is configured to operate 100 hosts, 10 edge switches connecting 10 hosts each, and one core switch that connects all edge switches.

• Host nodes

  1. type: "host"
  2. name: name of the host
  3. pes, mips, ram, storage : the host specification
  4. bw: connection bandwidth with the edge switch

• Switch nodes

  1. type: either "core", "aggregate" or "edge"
  2. name: name of the switch
  3. bw: maximum bandwidth support by switch

• Links

  1. source: the name of source node
  2. destination: the name of destination node

Virtual topology (Resource deployment request)

When customers send VM creation requests to the cloud data center, they provide virtual topology for their network QoS and SLA. Virtual topology consists of VM types and virtual links between VMs. This can input as JSON file. Please look at sdn-example-virtual.json file.

The resource deployment file includes 500 VM creation requests in which three to five VMs are grouped in a same virtual network to communicate with each other.

• Nodes
  1. type: "vm"
  2. name: name of the vm
  3. pes, mips, ram, size: the VM specification
• Links
  1. name: the name of the link that can be used in workloads. For default link, use "default"
  2. source: the name of source VM
  3. destination: the name of destination VM
  4. bandwidth (optional): specifically requested bandwidth for the link

Workloads (workload.csv)

After VMs are created in the data center, computation and network transmission workloads from end-users are passed to VMs to be processed. A workload consists of compute processing and network transmission. This can input as CSV file. Please look at sdn-example-workload-*.csv files

Workload file has a long packet transmission between VMs in a same virtual network. Since we should measure power consumption of switches, data transmissions between VMs are necessary to let switches work for the experiment time. To make the experiment simple, we make VMs use network bandwidth in full during their lifetime, so that just one long packet transmission workload for each VM is given in the workload file.

• CSV file structure
  1. Submission time
  2. Submission VM (VM1)
  3. Packet size of the transmission to VM1 (use 0)
  4. Computational workload for VM1
  5. The name of virtual link to transfer packet to the next VM (VM2)
  6. The next VM (VM2)
  7. Packet size of the transmission to VM2
  8. Computational workload for VM2
  9. ... (repeat v ~ viii)

A tutorial for 3-tier web application (wikipedia) workloads: https://github.com/Cloudslab/sfcwikiworkload

Simulation Execution

You have to build the project using your IDE or typing mvn clean install at the project's root directory. After that, to execute the example, enter the project's target directory and use the following command:

java -cp cloudsimsdn-1.0-with-dependencies.jar org.cloudbus.cloudsim.sdn.example.SDNExample <LFF|MFF> [physical.json] [virtual.json] [workload1.csv] [workload2.csv] [...]

• <LFF | MFF>: Choose VM placement policy. LFF(Least Full First) or MFF(Most Full First)
• [physical.json]: Filename of physical topology (data center configuration)
• [virtual.json]: Filename of virtual topology (VM creation and network request)
• [workload1.csv] ...: Filenames of workload files. Multiple files can be supplied.

EXAMPLE:

java -cp cloudsimsdn-1.0-with-dependencies.jar org.cloudbus.cloudsim.sdn.example.SDNExample MFF ../dataset-energy/energy-physical.json ../dataset-energy/energy-virtual.json ../dataset-energy/energy-workload.csv > results.out

This command will run the simulation using MFF algorithm, and the output is redirected to results.out file.

Simulation results

The results have five parts.

• Part 1) Detailed result of workloads: shows computational time and transmission time of each workload components. It also shows total response time of each workload.
• Part 2) Average result of workloads: shows the total number of workloads, average rate of all workload requests, and the average response time.
• Part 3) Host power consumption and detailed utilization: shows total power consumption and detailed utilization history (in MIPS) for each host
• Part 4) Switch power consumption and detailed utilization: shows total power consumption and detailed utilization history (in number of active ports) for each switch
• Part 5) Total power consumption: shows total power consumption over the data center with the maximum hosts utilized at the same time

EXAMPLE:

• Part 1 / 2) In our example, part 1 and 2 (for workload results) is not useful; because the workload is generated solely to make switches work for the whole lifetime of communicating VMs.
• Part 3 / 4)

Host #0: 29653.168930555563
0.0, 4000.0
0.0, 16000.0
0.0, 35200.0
0.0, 51200.0
2390.0, 55200.0
2423.0, 59200.0
...
Switch #103: 27511.461264316662
22660.21001, 2
90180.21001, 3
502117.0, 2
1458312.66651, 0

Part 3 and 4 shows the detailed power consumption and utilization level of each host or switch. For Host #0, it consumed 29,653 Wh which hosted 4 VMs at the time 0. From the time 0 until 2390, the host utilized 51200 MIPS. For Switch #103, it consumed 27,511 Wh for the whole experiment. No traffic was occurred until the time 22660, and 2 ports were active between 22660 and 90180 seconds.

• Part 5)

========== TOTAL POWER CONSUMPTION ===========
Host energy consumed: 1848038.3846250002
Switch energy consumed: 92493.37391543222
Total energy consumed: 1940531.7585404324
Simultanously used hosts:30

Part 5 is the main result of this example. Using MFF policy, total energy consumption of the data center was 1,940,531Wh and at most 30 hosts were used at the same time.

To compare with the result of LFF policy, run the same program with 'LFF' parameter instead of 'MFF'. The result shows that 2,508,871Wh was consumed with LFF policy.

Generate different scenarios

1. Use topology generators (org.cloudbus.cloudsim.sdn.example.topogenerators) to create more complex scenario in larger scale.
2. Implement different VM allocation policy to test different VM placement algorithms
3. Implement different NetworkOperatingSystem to test different network policies.

Publication

For the newest Edge computing, NFV and SFC version, please cite this paper:

• Jungmin Son, TianZhang He, and Rajkumar Buyya, "CloudSimSDN-NFV: Modeling and Simulation of Network Function Virtualization and Service Function Chaining in Edge Computing Environments", Software: Practive and Experience. 2019;1–17.https://doi.org/10.1002/spe.2755

Please cite this paper:

• Jungmin Son, Amir Vahid Dastjerdi, Rodrigo N. Calheiros, Xiaohui Ji, Young Yoon, and Rajkumar Buyya, "CloudSimSDN: Modeling and Simulation of Software-Defined Cloud Data Centers", Proceedings of the 15th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid 2015), Shenzhen, China, May 4-7, 2015. doi:10.1109/CCGrid.2015.87

cloudsimsdn's Issues

Cloudsim SDN installation

Hi;

I am using Cloudsim simulation tool integrated in Eclipse IDE, how can I add the SDN tool to my environment? is there an installation guide?
Your kind respond is highly appreciated
Kind regards;

ALI

GUI

Hi,
I have some questions regarding CloudsimSDN

1.What class or package is about GUI?I want to use GUI to build topology.
2.There is error when use run arguments you applied,the error is on PEs form org.cloudbus.cloudsim

cloudsimSDN

Hi.
I try to run SimpleExampleInterCloud of cloudsimSDN in Command Line but I face with a error.I enterJava -cp /*.. src.org.cloudbus.cloudsim.sdn.example.SimpleExampleInterCloud LFF C:\Users\Life\Documents\NetBeansProjects\cloudsimSDN3\example-intercloud \intercloud.physical.json C:\Users\Life\Documents\NetBeansProjects\cloudsimSDN3\example-intercloud\intercloud.virtual.json C:\Users\Life\Documents\NetBeansProjects\cloudsimSDN3\ example-intercloud\intercloud-example-workload.csv C:\Users\Life\Documents\NetBeansProjects\cloudsimSDN3\ example-intercloud\intercloud-example-workload2.csv > resul.out in Command Line but it shows an Error:Could not find or load main class src.org.cloudbus.cloudsim.sdn.example.SimpleExampleInterCloud

CloudsimSDN workload

First, thanks to great to provide me a useful simulator for evaluation of edge computing and NFV,SDN. I want to ask some questions about simulator.
(1) I experimented SFC placement algorithm in two ways(One is using full workloads(4000 workloads), the other is using only 1 workloads. I found when i execute only 1 workloads, servetime of that workload is really time-consuming(about 25 seconds per) but when i execute 4000 workloads, servetime of that workloads is very short(0.1~1.1). Can i know the reason?
(2) Is it possible to change the processing/transmission delay depending on host/link utilization?

Best regards,

VM replication

Would it be possible to perform VM replication on this simulator? If so, would a new class/package need to be created, or would I be able to modify any existing ones?

Thank you.

Bandwidth Unit in CloudSimSDN-NFV

Hi,

I have a simple question as I am currently working on simulator. May I know whether the bandwidth given in virtual topology link file is in Gigabits/sec or MegaBytes? it will be really helpful if I know the exact unit.

Thanks and regards,
Kavya

compiling error

Hey, I am trying to compile and run CloudSimSDN on my machine but I've faced this error:
java:128: error: incompatible types: Collection cannot be converted to Collection<? extends SDNHost>
hg.hosts = new ArrayList((Collection<? extends SDNHost>)topology.getConnectedNodesLow(e));
^
1 error
unfortunately, I couldn't figure out the error. I should run this as soon as possible.

Compiling Issue

By applying commands, as mentioned in doc, it is producing an error. How to compile it ?

StartExperimentSFCEdge can not find energy-physical.json_5_MFF_log.out.txt

Hi
when I try to run the StartExperimentSFCEdge and StartExperimentSFC codes "this file not found the error" occurs:

Exception in thread "main" java.io.FileNotFoundException: ./SFC_Off_dataset-energy/energy-physical.json_5_MFF_log.out.txt (No such file or directory)
at java.io.FileOutputStream.open0(Native Method)
at java.io.FileOutputStream.open(FileOutputStream.java:270)
at java.io.FileOutputStream.(FileOutputStream.java:213)
at java.io.FileOutputStream.(FileOutputStream.java:101)
at org.cloudbus.cloudsim.sdn.example.StartExperimentSFCEdge.main(StartExperimentSFCEdge.java:189)

Would you please tell me how can figure out this problem. This is an emergency for me :(
Best regards,

BUILD FAILURE - cloudsimsdn: Compilation failure

/D:/... .../cloudsimsdn-master/cloudsimsdn-master/src/main/java/org/cloudbus/cloudsim/sdn/virtualcomponents/VirtualNetworkMapper.java:[6,29] couldn't find symbol.

A lot .java couldn't find symbols and .core doesn't exist.

Cannot creta project from Cloudsimsdn pom file

Hi,

I'm having some problems while installing cloudsimsdn using mvn clean install. follow is the returnd error:

Failed to execute goal on project cloudsimsdn: Could not resolve dependencies for project org.cloudbus:cloudsimsdn:jar:1.0: Failure to find org.cloudbus.cloudsim:cloudsim:jar:4.0 in https://repo.maven.apache.org/maven2 was cached in the local repository, resolution will not be reattempted until the update interval of central has elapsed or updates are forced -

Besides that, when I import the cloudsimsdn pom file in IntelliJ to create a project, it cannot recognize some imports like:

mport org.cloudbus.cloudsim.DatacenterCharacteristics;
import org.cloudbus.cloudsim.Host;
import org.cloudbus.cloudsim.Log;
import org.cloudbus.cloudsim.Storage;
import org.cloudbus.cloudsim.VmAllocationPolicy;
import org.cloudbus.cloudsim.core.CloudSim;

Therefore, I cannot test some scenarios because of such errors.

Can anyone help me to solve them?

thanks

CloudSimSDN: Modeling and Simulation of Software-Defined Cloud Data Centers

Hello, i am trying to repeat the first simulation in the paper CloudSimSDN: Modeling and Simulation of
Software-Defined Cloud Data Centers where the author compares the results with the mininet.does anyone know which code in cloudsimsdn to use?i also want to measure cpu and memory but can t find a calss that does that.thank you in advance

reset vms

Hello i am running a simulation i want to repeat it 10 times and print the average.i am having problem reseting the vms does anyone have a method to achieve this?

Adding data center dynamically

hello
is it possible to add new data center dynamically.i face problem during adding data center dynamically

Feature request: simple workload generator

Less of an issue, more of a feature request. Since you must be generating your workload csvs in some way, I would recommend adding a basic workload generator, at least so people could use it as a template to create their own and be comparable.

pom.xml file needs to be updated to reflect dependency to cloudsim 4.0 (currently says 3.0.3)

Readme currently states that cloudsim 4 is needed, but the pom.xml file still requires 3.0.3.

Readme:
Program dependencies

You have to download CloudSim (cloudsim-4.0), enter the project's root directory and execute mvn clean install to install the jar packages into your local maven repository.

Other dependencies are already included.

pom file:

<dependency>
            <groupId>org.cloudbus.cloudsim</groupId>
            <artifactId>cloudsim</artifactId>
            <version>3.0.3</version>
</dependency>

CloudSim SDN-NFV

Hi,
I have few questions regarding CloudSim SDN-NFV-

1. What is the unit of arrival time of packets specified in workload file? Second? milli seconds?
2. Observing the Output in console- I have tried giving input file with a packet arrival time between (0-0.360) but the simulator console executes till 7.067199996. how does simulator converts arrival time of packet to cloudsim.clock?
3. May I know if it possible to force the simulator to duplicate VNF at certain time?

Answers will be appreciated. Thank you

Tutorial Needed

Hi,

Is there any working example or a tutorial regarding CloudSim-SDN? which could explain how practically CloudSim-SDN Version is working!!!

DataCenter dc is null

Tried to run the examples but getting the below error (tried both master and latest release 2.0.1-beta).
The mvn clean install finished successfully.
using java 1.8, with eclipse Version: 2021-09 (4.21.0)

============= SDNBroker.printResult() Group analysis =======================
Group num: 0, groupNumWorkloads:114
Group num: 0, groupTotalServetime:330.2069866666666
Group num: 0, groupTotalServetimeCPU:188.06399999999994
Group num: 0, groupTotalServetimeNetwork:142.14298666666662
Group num: 0, group avg Serve time:2.8965525146198825
Group num: 0, group avg Serve time CPU:1.6496842105263152
Group num: 0, group avg Serve time Network:1.2468683040935669
103.0: ========== EXPERIMENT FINISHED ===========
java.lang.NullPointerException: Cannot invoke "org.cloudbus.cloudsim.sdn.physicalcomponents.SDNDatacenter.getNOS()" because "dc" is null
	at org.cloudbus.cloudsim.sdn.example.SimpleExampleInterCloud.getAllHostList(SimpleExampleInterCloud.java:212)
	at org.cloudbus.cloudsim.sdn.example.SimpleExampleInterCloud.startSimulation(SimpleExampleInterCloud.java:192)
	at org.cloudbus.cloudsim.sdn.example.SimpleExampleInterCloud.main(SimpleExampleInterCloud.java:168)
Unwanted errors happen 

Reading result file

In example experimented SFC How to print result of the host cpu and BW utilization history with specified time intervals in cloudsimsdn?

While running the example I'm getting class not found exception error

Command run:
java -cp cloudsimsdn-1.0-with-dependencies.jar org.cloudbus.cloudsim.sdn.example.SDNExample MFF ../dataset-energy/energy-physical.json ../dataset-energy/energy-virtual.json ../dataset-energy/energy-workload.csv > results.out

Error: Could not find or load main class org.cloudbus.cloudsim.sdn.example.SDNExample
Caused by: java.lang.ClassNotFoundException: org.cloudbus.cloudsim.sdn.example.SDNExample

I implemented method 1 in installing and changed pom.xml as well. I've run mvn clean install and the build was successful
mvn clean install output:
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 7.922 s
[INFO] Finished at: 2021-08-12T12:39:05+05:30

CloudSimSDN Installation

Hi;

I am using Cloudsim simulation tool integrated in Eclipse IDE, how can I add the SDN tool to my environment? is there an installation guide for CloudSimSDN ????
Your kind respond is highly appreciated
Kind regards;

Compilation error

I ran one of the examples: SimpleExample and the error showed that a required function named getCloudletFailedList() is missing in CloudletScheduler. Don't know if that's because I have made some mistake somewhere or just because the function is actually missing. Any helpful answer will be appreciated!

Example run error

Hi
when I try to run the StartExperimentSFCEdge and SimpleExampleInterCloud codes, some error occurs:
The run configuration is set according to the tutorial.

SimpleExampleInterCloud:
java.lang.NullPointerException at org.cloudbus.cloudsim.sdn.example.SimpleExampleInterCloud.getAllHostList(SimpleExampleInterCloud.java:212) at org.cloudbus.cloudsim.sdn.example.SimpleExampleInterCloud.startSimulation(SimpleExampleInterCloud.java:192) at org.cloudbus.cloudsim.sdn.example.SimpleExampleInterCloud.main(SimpleExampleInterCloud.java:168) Unwanted errors happen

StartExperimentSFCEdge:
java.lang.Exception: net : Error - this entity has no PEs. Therefore, can't process any Cloudlets. at org.cloudbus.cloudsim.Datacenter.<init>(Datacenter.java:104) at org.cloudbus.cloudsim.sdn.physicalcomponents.SDNDatacenter.<init>(SDNDatacenter.java:61) at org.cloudbus.cloudsim.sdn.example.StartExperimentSFCEdge.createSDNDatacenter(StartExperimentSFCEdge.java:441) at org.cloudbus.cloudsim.sdn.example.StartExperimentSFCEdge.createPhysicalTopology(StartExperimentSFCEdge.java:377) at org.cloudbus.cloudsim.sdn.example.StartExperimentSFCEdge.main(StartExperimentSFCEdge.java:291)

java.lang.NullPointerException at org.cloudbus.cloudsim.sdn.example.StartExperimentSFCEdge.getAllHostList(StartExperimentSFCEdge.java:360) at org.cloudbus.cloudsim.sdn.example.StartExperimentSFCEdge.startSimulation(StartExperimentSFCEdge.java:340) at org.cloudbus.cloudsim.sdn.example.StartExperimentSFCEdge.main(StartExperimentSFCEdge.java:316)

Any helpful answer will be appreciated! Thank you!

Error in getCurrentOverbookingRatioMips function

Multi-Controller Support

I want to categorize Data center and use controllers for each cluster that can support its domain. finally all off them syncing with a root controller. is there any way to do it?

Fat tree

Hello, I implemented a fat tree topology. However, whenever I try to have 2 specific virtual machines communicate with each other, it says it cannot find the path from the source virtual machine to the destination. Any help would be appreciated. Thank you.