iotsharp / iotsharp

IoTSharp is an open-source IoT platform for data collection, processing, visualization, and device management.

IoTSharp is an open-source IoT platform for data collection, processing, visualization, and device management.

Here is a blessing for all users of this project

• May you do good and not evil.
• May you find forgiveness for yourself and forgive others.
• May you share freely, never taking more than you give.

What databases are supported?

• PostgreSql The test environment is PostgreSQL 11.3,Support for sharding.
• MySql The test environment is MySQL 8.0.17,Support for sharding.
• Oracle The test environment is Oracle Standard Edition 12c Release 2 on CentOS , Support for sharding. See also: https://github.com/MaksymBilenko/docker-oracle-12c
• SQLServer Microsoft SQL Server 2016 (RTM-GDR) (KB4019088) - 13.0.1742.0 (X64) ,Support for sharding
• Sqlite Support for sharding
• Cassandra

What time series databases are supported??

• InfluxDB
• IoTDB
• TDengine
• TimescaleDB
• PinusDB
• Relational databases are also supported, either single tables or sharding.

What EventBus Message Queue are supported?

• RabbitMQ
• Kafka
• InMemory
• ZeroMQ
• NATS
• Pulsar
• RedisStreams
• AmazonSQS
• AzureServiceBus

What EventBus Store are supported?

• PostgreSql,
• MongoDB,
• InMemory,
• LiteDB,
• MySql,
• SqlServer

IoTSharp Demo

• IoTSharp front-end implemented using Vue3

IoTSharp cloud

https://cloud.iotsharp.net/

doc

https://docs.iotsharp.net/

How to deploy?

• Deploy by Docker
• Deploy to Linux
• Deployed to Windows

How to configure?

• AppSettings

IoTSharp.SDKs

• IoTSharp.Sdk.Http
• IoTSharp.Sdk.MQTT

IoTSharp-C-Client-Sdk

IoTSharp-C-client-Sdk is mqttt client, write by c;

https://github.com/IoTSharp/IoTSharp.Sdks.MQTT-C

paho.mqtt.c's demo

It' like IoTSharp-C-Client-Sdk, but is use paho.mqtt.c https://github.com/IoTSharp/IoTSharp.Edge.paho.mqtt.c

IoTSharp for nanoFramework

IoTSharp.Edge.nanoFramework is a nanoFramework's mqtt client , it run on STM32 ！

https://github.com/IoTSharp/IoTSharp.Edge.nanoFramework

more info read https://www.cnblogs.com/MysticBoy/p/13159648.html or click https://www.nanoframework.net/

IoTSharp for RTthread Package

https://github.com/IoTSharp/iotsharp-rtthread-package

IoTSharp's ecosystem

• IoTSharp.Sdk.Http
• IoTSharp.Sdk.MQTT
• MQTTnet.AspNetCore.Routing
• IoTSharp.EntityFrameworkCore.Taos
• IoTSharp.X509Extensions
• IoTSharp.Extensions.RESTful
• IoTSharp.Extensions.QuartzJobScheduler
• IoTSharp.Extensions.EFCore
• IoTSharp.Extensions.BouncyCastle
• IoTSharp.Extensions.AspNetCore
• IoTSharp.Extensions

Contributing

If you would like to contribute, feel free to create a Pull Request, or give us Bug Report.

Contributors

This project exists thanks to all the people who contribute.

Donation

This project is an Apache 2.0 licensed open source project. In order to achieve better and sustainable development of the project, we expect to gain more backers. We will use the proceeds for community operations and promotion. You can support us in any of the following ways:

• OpenCollective
• 爱发电
• 捐赠者名单
• 微信

Community Support

If you encounter any problems in the process, feel free to ask for help via following channels. We also encourage experienced users to help newcomers.

公众号	QQ群63631741	微信群

dotNET China

优秀开源社区

• LinkWeChat LinkWeChat 是基于企业微信的开源 SCRM 系统，是企业私域流量管理与营销的综合解决方案。
• IoTSharp IoTSharp 是一个 基于.Net Core 开源的物联网基础平台， 支持 HTTP、MQTT 、CoAp 协议
• 流之云 信息化、数字化服务提供商
• translate.js 网页自动翻译，页面无需另行改造，加入两行js即可让你的网页快速具备多国语言切换能力！
• IoTGateway IoTGateway是一个基于.Net6.0 开源的物联网网关，通过可视化配置，轻松的连接到你的任何设备和物联网平台。

iotsharp's Issues

docker-compose 启动 rabbit_mongo_influx 创建设备失败

An error occurred while saving the entity changes. See the inner exception for details.\n ---\u003E System.InvalidCastException: Cannot write DateTime with Kind=Local to PostgreSQL type \u0027timestamp with time zone\u0027, only UTC is supported. Note that it\u0027s not possible to mix DateTimes with different Kinds in an array/range. See the Npgsql.EnableLegacyTimestampBehavior AppContext switch to enable legacy behavior.

我提交过一次pr，源码启动已经解决了这个问题，可能docker镜像的版本没有合并？

        AppContext.SetSwitch("Npgsql.EnableLegacyTimestampBehavior", true);
        AppContext.SetSwitch("Npgsql.DisableDateTimeInfinityConversions", true);

Fix code scanning alert - Hard-coded credentials

Tracking issue for:

• https://github.com/IoTSharp/IoTSharp/security/code-scanning/57

Unhandled exception. System.TypeLoadException: Could not load type 'Microsoft.EntityFrameworkCore.NpgsqlDbContextOptionsExtensions' from assembly 'Npgsql.EntityFrameworkCore.PostgreSQL, Version=5.0.0.0,

Unhandled exception. System.TypeLoadException: Could not load type 'Microsoft.EntityFrameworkCore.NpgsqlDbContextOptionsExtensions' from assembly 'Npgsql.EntityFrameworkCore.PostgreSQL, Version=5.0.0.0,

源码启动iotsharp，rabbit+mongo+influx 遥测数据写入influx失败

IoTSharp.Storage.InfluxDBStorage[0]
4e587702-fc6e-4239-aac3-4d1df0681635数据处理失败Method not found: 'Void RestSharp.RestClient.set_UserAgent(System.String)'.
System.MissingMethodException: Method not found: 'Void RestSharp.RestClient.set_UserAgent(System.String)'.
at InfluxDB.Client.InfluxDBClient..ctor(InfluxDBClientOptions options)
at InfluxDB.Client.InfluxDBClientFactory.Create(InfluxDBClientOptions options)
at InfluxDB.Client.InfluxDBClientFactory.Create(String connectionString)
at IoTSharp.Startup.<>c__DisplayClass5_0.b__23() in D:\Repos\IoTSharp\IoTSharp\Startup.cs:line 267
at Microsoft.Extensions.ObjectPool.DefaultObjectPool1.Create() at Microsoft.Extensions.ObjectPool.DefaultObjectPool1.Get()
at IoTSharp.Storage.InfluxDBStorage.StoreTelemetryAsync(RawMsg msg) in D:\Repos\IoTSharp\IoTSharp\Storage\InfluxDBStorage.cs:line 236

网关设备请求属性

目前只实现了直连设备属性请求支持， 网关设备请求子设备请求未实现。

IStorage InfluxDB

InfluxDB 1.0

- [ ] 存储数据
- [ ] 加载最新
- [ ] 按时间加载

InfluxDB 2.0

• 存储数据
• 加载最新
• 按时间加载

1. 基本的文件存储功能。

希望补充[规则链]相关的文档和demo

如题!

使用docker-compose启动后报错，iotsharp退出139

使用docker-compose启动后报错，

iotsharp | at IoTSharp.Program.Main(String[] args) in /src/IoTSharp/Program.cs:line 20
iotsharp | Exception data:
iotsharp | Severity: ERROR
iotsharp | SqlState: 42704
iotsharp | MessageText: index "IX_DataStorage_Catalog_DeviceId_KeyName_DateTime" does not exist
iotsharp | File: tablecmds.c
iotsharp | Line: 1185
iotsharp | Routine: DropErrorMsgNonExistent
iotsharp exited with code 139

https://gitee.com/IoTSharp/IoTSharp/issues/I1VGU6

EntityFrameworkCore.ClickHouse

支持 EntityFrameworkCore.ClickHouse

使用Controllers Action方式处理mqtt消息

https://github.com/Atlas-LiftTech/MQTTnet.AspNetCore.AttributeRouting
需要改造。

1. 设备和网关可以隶属于某个产品

Warning: Invalid dependencies have been reported by plugins or loaders for this module. All reported dependencies need to be absolute paths.

Build at: 2022-06-18T16:38:48.121Z - Hash: 7d7682d06be0cd0d - Time: 73828ms

./src/styles.less.webpack[javascript/auto]!=!./node_modules/css-loader/dist/cjs.js??ruleSet[1].rules[8].rules[0].oneOf[0].use[1]!./node_modules/postcss-loader/dist/cjs.js??ruleSet[1].rules[8].rules[0].oneOf[0].use[2]!./node_modules/less-loader/dist/cjs.js??ruleSet[1].rules[8].rules[1].use[0]!./src/styles.less - Warning: Invalid dependencies have been reported by plugins or loaders for this module. All reported dependencies need to be absolute paths.
Invalid dependencies may lead to broken watching and caching.
As best effort we try to convert all invalid values to absolute paths and converting globs into context dependencies, but this is deprecated behavior.
Loaders: Pass absolute paths to this.addDependency (existing files), this.addMissingDependency (not existing files), and this.addContextDependency (directories).
Plugins: Pass absolute paths to fileDependencies (existing files), missingDependencies (not existing files), and contextDependencies (directories).
Globs: They are not supported. Pass absolute path to the directory as context dependencies.
The following invalid values have been reported:
 * "node_modules\\ng-zorro-antd\\code-editor\\style\\entry.less"
 * "node_modules\\ng-zorro-antd\\code-editor\\style\\index.less"
 * "node_modules\\ng-zorro-antd\\resizable\\style\\entry.less"
 * and more ...

GetHealthReport threw an exception when trying to get report from /healthz configured with name IoTSharp

  fail: HealthChecks.UI.Core.HostedService.HealthCheckReportCollector[0]
     GetHealthReport threw an exception when trying to get report from /healthz configured with name IoTSharp.
       System.Net.Http.HttpRequestException: IPv4 address 0.0.0.0 and IPv6 address ::0 are unspecified addresses that cannot be used as a target address. (Parameter 'hostName') ([::]:80)
      ---> System.ArgumentException: IPv4 address 0.0.0.0 and IPv6 address ::0 are unspecified addresses that cannot be used as a target address. (Parameter 'hostName')
         at System.Net.Dns.GetHostEntryOrAddressesCoreAsync(String hostName, Boolean justReturnParsedIp, Boolean throwOnIIPAny, Boolean justAddresses)
          at System.Net.Sockets.MultipleConnectAsync.StartConnectAsync(SocketAsyncEventArgs args, DnsEndPoint endPoint)
        at System.Net.Sockets.Socket.ConnectAsync(SocketAsyncEventArgs e, Boolean userSocket)
       at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ConnectAsync(Socket socket)
         at System.Net.Sockets.Socket.ConnectAsync(EndPoint remoteEP, CancellationToken cancellationToken)
       at System.Net.Http.HttpConnectionPool.DefaultConnectAsync(SocketsHttpConnectionContext context, CancellationToken cancellationToken)
        at System.Net.Http.ConnectHelper.ConnectAsync(Func`3 callback, DnsEndPoint endPoint, HttpRequestMessage requestMessage, CancellationToken cancellationToken)
        --- End of inner exception stack trace ---
        at System.Net.Http.ConnectHelper.ConnectAsync(Func`3 callback, DnsEndPoint endPoint, HttpRequestMessage requestMessage, CancellationToken cancellationToken)
        at System.Net.Http.HttpConnectionPool.ConnectAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
       at System.Net.Http.HttpConnectionPool.CreateHttp11ConnectionAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
        at System.Net.Http.HttpConnectionPool.GetHttpConnectionAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
       at System.Net.Http.HttpConnectionPool.SendWithRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
      at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
        at Microsoft.Extensions.Http.Logging.LoggingHttpMessageHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
        at Microsoft.Extensions.Http.Logging.LoggingScopeHttpMessageHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
     at System.Net.Http.HttpClient.SendAsyncCore(HttpRequestMessage request, HttpCompletionOption completionOption, Boolean async, Boolean emitTelemetryStartStop, CancellationToken cancel

遥测数据建议分表存储

https://github.com/Coldairarrow/EFCore.Sharding

BlockingCollection引发的asp.net core服务不能启动问题

简单改了下代码，还没有完全看完整个流程，所以不确定会不会引发其它问题

                        if (!_handler.IncomingMessages.TryTake(out message))
                        {
                            return;
                        }

                       // message = _handler.IncomingMessages.Take(cancellationToken);
                        if (message == null || cancellationToken.IsCancellationRequested)
                        {
                            return;
                        }

新规划 文件管理、产品

产品整体改造

• #780
• #782
• #783
• #784
• #785
• #786
• #777
• 时序数据库进行剥离为单独项目
• 移动数据库访问至单独目录
• 重构扩展方法
• #794
• #795
• 取消在线和状态， 现在在服务侧属性。

文档部分

• Docker-Compose 部署
• Linux部署
• Windows下部署
• 苹果系统部署
• 录制视频如何编译并启动IoTSharp

文件管理 下面的功能废弃 。

• #787
• #788
• #789
• #790
• #791
• #792
• #793

官网不能登录

http://www.iotsharp.net 官网不能成功登录

Fix code scanning alert - Hard-coded credentials

Tracking issue for:

• https://github.com/IoTSharp/IoTSharp/security/code-scanning/56

Fix code scanning alert - Information exposure through transmitted data

Tracking issue for:

• https://github.com/IoTSharp/IoTSharp/security/code-scanning/65

5. 根据属性值查询设备

希望有好的教程和Demo支持

仓库挺好👏

docker版Devices?customerId=接口查不到设备数据

“网关”设备添加成功，数据库中查看TenantId和CustomerId也正确，调用Devices获取客户的设备返回：

{"data":"00000000-0000-0000-0000-000000000000","code":10013,"msg":"The customer does not have any device"}

网关的虚拟设备 去判断 mqtt状态的问题

/50ca7e63-e08d-406f-b94b-8fcbb4a40a65/的数据devices/SmartHelmet_00945_8133002/telemetry未能识别,分段:3 前缀?devices 设备: ,终端状态未找到。

完善wiki 説明一下如何對接設備，

諸如 如何連接一個MQTTNET設備，如何處理設備的訂閲和發佈TOPIC 以及如何獲取和處理這些數據

4. 固件管理和升级功能

using RulesEngine

RulesEngine

'Minimum configured megabytes for disk /proc is 1024 but actual free space are 0 megabyte

Health check Disk Storage completed after 0.2908ms with status Unhealthy and description 'Minimum configured megabytes for disk /proc is 1024 but actual free space are 0 megabyt

有没有docker运行教程的

有没有docker运行教程的,
下载下来之后直接运行报错。

Fix code scanning alert - Information exposure through transmitted data

Tracking issue for:

• https://github.com/IoTSharp/IoTSharp/security/code-scanning/65

DTU透传数据上来，dtu算设备还是网关？？

比如一个485的DTU，
下面接了6个modbus设备，站号1,2,3,4,5,6
{
"dev-name": "Token",
"poll-data": {
"设备1": "11.11",
"设备2": "2.22",
"设备3": "3.33",
"设备4": "-4.44",
"设备5": "2.22",
"设备6": "abcd1234efgh"
}
}

那么这个DTU是设备还是网关？？？
那么不管设备还是网关Token能不能自定义或者编辑修改？？？？

IStorage Cassandra

Cassandra
https://github.com/datastax/csharp-driver

按照步骤，linux里跑不起来，报错

centos里按照教程执行：
mkdir /var/lib/iotsharp/
cp ./* /var/lib/iotsharp/
chmod 777 /var/lib/iotsharp/IoTSharp
cp iotsharp.service /etc/systemd/system/iotsharp.service
sudo systemctl enable /etc/systemd/system/iotsharp.service
sudo systemctl start iotsharp.service
sudo journalctl -fu iotsharp.service

报错！！！:“failed at step USER spawning /var/lib/iotsharp/IoTSharp: No such process”

http://127.0.0.1:80/

ZeroMQ运行稳定吗？

设备遥测历史趋势图显示

• 设备=>遥测=>历史=>图表

• 时间无法显示年、时分秒等
  
  

• delon的组件bug？

2. 图标文件

问一下，这个库为啥没有做nuget发布？至少核心库应该发nuget

如题

>无法解决“BouncyCastle.Crypto, Version=1.8.6.0, Culture=neutral, PublicKeyToken=null”与“BouncyCastle.Crypto, Version=1.8.1.0, Culture=neutral, PublicKeyToken=0e99375e54769942”之间的冲突。正在随意选择“BouncyCastle.Crypto, Version=1.8.6.0, Culture=neutral, PublicKeyToken=null”。

无法解决“BouncyCastle.Crypto, Version=1.8.6.0, Culture=neutral, PublicKeyToken=null”与“BouncyCastle.Crypto, Version=1.8.1.0, Culture=neutral, PublicKeyToken=0e99375e54769942”之间的冲突。正在随意选择“BouncyCastle.Crypto, Version=1.8.6.0, Culture=neutral, PublicKeyToken=null”。

datastorage和telemetrydata中部分数据字段的是否应允许为空

以下字段默认为非空：
Value_Boolean、Value_Long、Value_DateTime、Value_Double
是否考虑设置为可空，同时实体类设置为类型bool?等。

解决问题：不同数据库的字段例如TIMESTAMP最小值可能不同，例如mysql就无法保存"0-0-0 0:0:0"
如果不允许为空，则必须设置一个值，反而更麻烦。

.net core 3.0下不能运行

环境vs2019 for mac +.net core 3.0，克隆最新的代码，调试运行提示 堆栈溢出

2. 产品具备基本的服务侧属性和共享属性，新建和修改设备都应该保持跟产品的服务侧和共享属性同步。

MQTT协议透传上来的modbus/modbus TCP 协议不能用？？

协议方式

• HTTP
• MQTT
• COAP
• TCP
• UDP

 {
	"dev-name":	"30c6f7eb1d48",
	"poll-data":	{
		"wendu":	[6, 3, 2, 1, 206, 141, 128],
		"shidu":	[6, 3, 2, 1, 194, 141, 133]
	}
}

更换消息组件

https://github.com/dotnet-shashlik/shashlik.eventbus

3. 产品具有产品说明、型号、图标、原理图、bom清单等上传资料的途径。

数据断面聚合

需求
一天内 一万条数据， 整合成一小时一条， 使用平均的方法， 或者每个小时的最后一条作为依据。
Task<List> LoadTelemetryAsync(Guid deviceId, string keys, DateTime begin, DateTime end, TimeSpan every, Aggregate aggregate);

注意
keys 为空则表示全部，
every 如果是 TimeSpan.Zero表示不适用。aggregate 也不会使用。

• #802
• #803
• #804
• InfluxDBStorage 已实现。
• #805
• #806
• IoTDB 已实现

IoTSharp.Edge.ModBus 不能迁移至 .net core 3.0

难道是因为 Quartzmin 不支持 .net core 3.0 ?

建議增加設備屬性和設備數據點接口

目前API接口還沒有增加 設備屬性和設備數據點的控制接口

No service for type 'Microsoft.AspNetCore.Http.Connections.Internal.HttpConnectionDispatcher' has been registered.

Describe the bug
System.InvalidOperationException:“No service for type 'Microsoft.AspNetCore.Http.Connections.Internal.HttpConnectionDispatcher' has been registered.”

Screenshots

Desktop (please complete the following information):

• OS: windows / centos
• Browser [e.g. chrome, safari]
• Version [e.g. 22]

vue客户端不能运行

Describe the bug
最新代码运行 npm run serve报错

To Reproduce
npm run serve

Expected behavior
error: Unexpected trailing comma (comma-dangle) at src\views\user\Register.vue:306:6:
304 | 'state.passwordLevel'(val) {
305 | console.log(val)

306 | },
| ^
307 | },
308 | }
309 | </script>

error: Unexpected trailing comma (comma-dangle) at src\views\user\Register.vue:307:4:
305 | console.log(val)
306 | },

307 | },
| ^
308 | }
309 | </script>
310 | <style lang="less">

23 errors and 1 warning found.
23 errors and 1 warning potentially fixable with the --fix option.

@ ./src/config/router.config.js 542:13-544:30
@ ./src/store/modules/permission.js
@ ./src/store/index.js
@ ./src/core/directives/action.js
@ ./src/core/lazy_use.js
@ ./src/main.js
@ multi (webpack)-dev-server/client?http://192.168.0.20:8000&sockPath=/sockjs-node (webpack)/hot/dev-server.js ./src/main.js

https://github.com/cloudtoid/interprocess

https://github.com/cloudtoid/interprocess