Comments (22)
donacarr
commented on June 30, 2024
1
Hi @bgandon
good news...the patch is working!
I found that migrate disk test in BAT was not configured properly for Softlayer when in January latest BAT code was pulled from git repo.
The minimum iscsi storage space is 20Gb in Softlayer....so the test ran with incorrect disk size (2Gb and 4Gb).
Thank you for your support.
Ciao.
from bosh-agent.
bgandon
commented on June 30, 2024
When I've contributed the IaaS-native disk resize logic recently, I tried to keep the heuristics about resolving correct device paths as they were before. But I've assumed that calling GetRealDevicePath() twice would produce the exact same result, whereas here with the iscsiDevicePathResolver strategy, it's unfortunately not the case.
When I’ve separated the disk-resize logic in AdjustPersistentDiskPartitioning() from the disk mounting logic in MountPersistentDisk(), I’ve kept similar calls to GetRealDevicePath(diskSetting) with the exact same argument, so that the resolved path is the same. It turns out that after AdjustPersistentDiskPartitioning() has properly partitioned the brand new disk for the very first time, then the heuristics iscsiDevicePathResolver.GetRealDevicePath() fail at computing the device path because the lastDiskID (as read from the managed_disk_settings.json file) is different from the diskSettings.ID value (because we deal with a brand new disk). So, the code accepts a brand new disk or a partitioned disk but not both. And here after AdjustPersistentDiskPartitioning() has run we are in the case where the brand new disk is partitioned.
So, I think that when the device is partitioned, bosh cases are valid: brand new disk or already previously mounted disk. I already have some patch for this that should solve the situation. I'll mention it here when I submit the PR.
Bigger problem is that possibly other device-path-resolving strategies could also fail at being called two times in a row. We should perform some review. If the contract is that GetRealDevicePath() is definitely not supposed to be called multiple times in a row, then we should provide a different patch.
from bosh-agent.
bgandon
commented on June 30, 2024
I've pushed a proposed patch in #253. Could you test it?
Do not hesitate to get in touch in Slack if ever you need any details about how to test this, and possibly set some pairing session up.
from bosh-agent.
donacarr
commented on June 30, 2024
Hi @bgandon , the fix is partially working.
Now the disk is mounted but then if I change the disk size in the manifest and redeploy it will fail again.
2021-11-24_09:01:13.33771 [linuxPlatform] 2021/11/24 09:01:13 DEBUG - Adjusting size for persistent disk {ID:299719082 DeviceID:299719082 VolumeID: Lun: HostDeviceID: Path: ISCSISettings:{InitiatorName:iqn.2021-11.zzzzz:xxxx Username:xxxx Target:10.201.110.118 Password:yyyyy} FileSystemType: MountOptions:[] Partitioner:}
2021-11-24_09:01:13.33778 [multipathDevicePathResolver] 2021/11/24 09:01:13 DEBUG - Failed to get device real path by disk ID: '299719082'. Error: 'Getting real device path: path is missing', timeout: 'false'
2021-11-24_09:01:13.33779 [multipathDevicePathResolver] 2021/11/24 09:01:13 DEBUG - Using iSCSI resolver to get device real path
2021-11-24_09:01:13.33784 [iscsiResolver] 2021/11/24 09:01:13 DEBUG - Last mounted disk CID: '299482396'
2021-11-24_09:01:13.33784 [Cmd Runner] 2021/11/24 09:01:13 DEBUG - Running command 'dmsetup ls'
2021-11-24_09:01:13.34034 [Cmd Runner] 2021/11/24 09:01:13 DEBUG - Stdout: 3600a098038305679445d523053437757 (253:0)
2021-11-24_09:01:13.34035 3600a098038305679445d523053437757-part1 (253:1)
2021-11-24_09:01:13.34036 [Cmd Runner] 2021/11/24 09:01:13 DEBUG - Stderr:
2021-11-24_09:01:13.34036 [Cmd Runner] 2021/11/24 09:01:13 DEBUG - Successful: true (0)
2021-11-24_09:01:13.34036 [iscsiResolver] 2021/11/24 09:01:13 DEBUG - devices: '[3600a098038305679445d523053437757 (253:0) 3600a098038305679445d523053437757-part1 (253:1)]'
2021-11-24_09:01:13.34037 [iscsiResolver] 2021/11/24 09:01:13 DEBUG - path in device list: '/dev/mapper/3600a098038305679445d523053437757'
2021-11-24_09:01:13.34037 [iscsiResolver] 2021/11/24 09:01:13 DEBUG - Existing real paths '[/dev/mapper/3600a098038305679445d523053437757]'
2021-11-24_09:01:13.34038 [OpenIscsiAdmin] 2021/11/24 09:01:13 INFO - Setup Open-iscsi, initializing /etc/iscsi/initiatorname.iscsi,iscsid.conf
2021-11-24_09:01:13.34038 [File System] 2021/11/24 09:01:13 DEBUG - Writing /etc/iscsi/initiatorname.iscsi
2021-11-24_09:01:13.34039 [File System] 2021/11/24 09:01:13 DEBUG - Making dir /etc/iscsi with perm 0777
2021-11-24_09:01:13.34039 [File System] 2021/11/24 09:01:13 DEBUG - Write content
2021-11-24_09:01:13.34056 ********************
2021-11-24_09:01:13.34057 InitiatorName=iqn.2021-11.zzzzz:xxxx
2021-11-24_09:01:13.34065 ********************
2021-11-24_09:01:13.34066 [File System] 2021/11/24 09:01:13 DEBUG - Writing /etc/iscsi/iscsid.conf
2021-11-24_09:01:13.34066 [File System] 2021/11/24 09:01:13 DEBUG - Making dir /etc/iscsi with perm 0777
2021-11-24_09:01:13.34067 [File System] 2021/11/24 09:01:13 DEBUG - Write content
2021-11-24_09:01:13.34067 ********************
2021-11-24_09:01:13.34068 # Generated by bosh-agent
2021-11-24_09:01:13.34068 node.startup = automatic
2021-11-24_09:01:13.34074 node.session.auth.authmethod = CHAP
2021-11-24_09:01:13.34075 node.session.auth.username = xxxx
2021-11-24_09:01:13.34076 node.session.auth.password = yyyyy
2021-11-24_09:01:13.34076 discovery.sendtargets.auth.authmethod = CHAP
2021-11-24_09:01:13.34077 discovery.sendtargets.auth.username = xxxx
2021-11-24_09:01:13.34077 discovery.sendtargets.auth.password = yyyyy
2021-11-24_09:01:13.34078 node.session.timeo.replacement_timeout = 120
2021-11-24_09:01:13.34078 node.conn[0].timeo.login_timeout = 15
2021-11-24_09:01:13.34079 node.conn[0].timeo.logout_timeout = 15
2021-11-24_09:01:13.34079 node.conn[0].timeo.noop_out_interval = 10
2021-11-24_09:01:13.34080 node.conn[0].timeo.noop_out_timeout = 15
2021-11-24_09:01:13.34080 node.session.iscsi.InitialR2T = No
2021-11-24_09:01:13.34080 node.session.iscsi.ImmediateData = Yes
2021-11-24_09:01:13.34081 node.session.iscsi.FirstBurstLength = 262144
2021-11-24_09:01:13.34081 node.session.iscsi.MaxBurstLength = 16776192
2021-11-24_09:01:13.34082 node.conn[0].iscsi.MaxRecvDataSegmentLength = 65536
2021-11-24_09:01:13.34089
2021-11-24_09:01:13.34089 ********************
2021-11-24_09:01:13.34090 [OpenIscsiAdmin] 2021/11/24 09:01:13 INFO - Restart Open-iscsi deamon
2021-11-24_09:01:13.34090 [Cmd Runner] 2021/11/24 09:01:13 DEBUG - Running command '/etc/init.d/open-iscsi restart'
2021-11-24_09:01:13.49281 [Cmd Runner] 2021/11/24 09:01:13 DEBUG - Stdout: Restarting open-iscsi (via systemctl): open-iscsi.service.
2021-11-24_09:01:13.49284 [Cmd Runner] 2021/11/24 09:01:13 DEBUG - Stderr:
2021-11-24_09:01:13.49284 [Cmd Runner] 2021/11/24 09:01:13 DEBUG - Successful: true (0)
2021-11-24_09:01:13.49285 [Cmd Runner] 2021/11/24 09:01:13 DEBUG - Running command '/etc/init.d/multipath-tools restart'
2021-11-24_09:01:13.69844 [Action Dispatcher] 2021/11/24 09:01:13 INFO - Received request with action get_task
2021-11-24_09:01:13.69846 [Action Dispatcher] 2021/11/24 09:01:13 DEBUG - Payload
2021-11-24_09:01:13.69846 ********************
2021-11-24_09:01:13.69847 {"protocol":3,"method":"get_task","arguments":["76eaa94d-129c-4885-5873-fe86ea6c4892"],"reply_to":"director.41c0f278-b82f-4fcd-a5ff-90bb27924de6.13fb166d-be40-4a37-9ca0-46d8239b22b8.5a0e9d36-d3c2-462a-af25-70b0e202cf3b"}
2021-11-24_09:01:13.69847 ********************
2021-11-24_09:01:13.69848 [Action Dispatcher] 2021/11/24 09:01:13 INFO - Running sync action get_task
2021-11-24_09:01:13.69855 [MBus Handler] 2021/11/24 09:01:13 INFO - Responding
2021-11-24_09:01:13.69858 [MBus Handler] 2021/11/24 09:01:13 DEBUG - Payload
2021-11-24_09:01:13.69858 ********************
2021-11-24_09:01:13.69859 {"value":{"agent_task_id":"76eaa94d-129c-4885-5873-fe86ea6c4892","state":"running"}}
2021-11-24_09:01:13.69860 ********************
2021-11-24_09:01:13.69986 [DelayedAuditLogger] 2021/11/24 09:01:13 DEBUG - Logging CEF:0|CloudFoundry|BOSH|1|agent_api|get_task|1|duser=director.41c0f278-b82f-4fcd-a5ff-90bb27924de6.13fb166d-be40-4a37-9ca0-46d8239b22b8.5a0e9d36-d3c2-462a-af25-70b0e202cf3b src=10.164.169.217 spt=4222 shost=13fb166d-be40-4a37-9ca0-46d8239b22b8 to syslog
2021-11-24_09:01:14.70142 [Action Dispatcher] 2021/11/24 09:01:14 INFO - Received request with action get_task
2021-11-24_09:01:14.70144 [Action Dispatcher] 2021/11/24 09:01:14 DEBUG - Payload
2021-11-24_09:01:14.70144 ********************
2021-11-24_09:01:14.70145 {"protocol":3,"method":"get_task","arguments":["76eaa94d-129c-4885-5873-fe86ea6c4892"],"reply_to":"director.41c0f278-b82f-4fcd-a5ff-90bb27924de6.13fb166d-be40-4a37-9ca0-46d8239b22b8.b172ed45-ac8b-4716-a0b3-e1200f1f53ba"}
2021-11-24_09:01:14.70146 ********************
2021-11-24_09:01:14.70146 [Action Dispatcher] 2021/11/24 09:01:14 INFO - Running sync action get_task
2021-11-24_09:01:14.70147 [MBus Handler] 2021/11/24 09:01:14 INFO - Responding
2021-11-24_09:01:14.70147 [MBus Handler] 2021/11/24 09:01:14 DEBUG - Payload
2021-11-24_09:01:14.70201 ********************
2021-11-24_09:01:14.70201 {"value":{"agent_task_id":"76eaa94d-129c-4885-5873-fe86ea6c4892","state":"running"}}
2021-11-24_09:01:14.70202 ********************
2021-11-24_09:01:14.70240 [DelayedAuditLogger] 2021/11/24 09:01:14 DEBUG - Logging CEF:0|CloudFoundry|BOSH|1|agent_api|get_task|1|duser=director.41c0f278-b82f-4fcd-a5ff-90bb27924de6.13fb166d-be40-4a37-9ca0-46d8239b22b8.b172ed45-ac8b-4716-a0b3-e1200f1f53ba src=10.164.169.217 spt=4222 shost=13fb166d-be40-4a37-9ca0-46d8239b22b8 to syslog
2021-11-24_09:01:15.70420 [Action Dispatcher] 2021/11/24 09:01:15 INFO - Received request with action get_task
2021-11-24_09:01:15.70424 [Action Dispatcher] 2021/11/24 09:01:15 DEBUG - Payload
2021-11-24_09:01:15.70424 ********************
2021-11-24_09:01:15.70425 {"protocol":3,"method":"get_task","arguments":["76eaa94d-129c-4885-5873-fe86ea6c4892"],"reply_to":"director.41c0f278-b82f-4fcd-a5ff-90bb27924de6.13fb166d-be40-4a37-9ca0-46d8239b22b8.f67abbbf-13b0-43d8-b1cf-2d83cbdb9df3"}
2021-11-24_09:01:15.70425 ********************
2021-11-24_09:01:15.70425 [Action Dispatcher] 2021/11/24 09:01:15 INFO - Running sync action get_task
2021-11-24_09:01:15.70426 [MBus Handler] 2021/11/24 09:01:15 INFO - Responding
2021-11-24_09:01:15.70426 [MBus Handler] 2021/11/24 09:01:15 DEBUG - Payload
2021-11-24_09:01:15.70426 ********************
2021-11-24_09:01:15.70427 {"value":{"agent_task_id":"76eaa94d-129c-4885-5873-fe86ea6c4892","state":"running"}}
2021-11-24_09:01:15.70427 ********************
2021-11-24_09:01:15.70506 [DelayedAuditLogger] 2021/11/24 09:01:15 DEBUG - Logging CEF:0|CloudFoundry|BOSH|1|agent_api|get_task|1|duser=director.41c0f278-b82f-4fcd-a5ff-90bb27924de6.13fb166d-be40-4a37-9ca0-46d8239b22b8.f67abbbf-13b0-43d8-b1cf-2d83cbdb9df3 src=10.164.169.217 spt=4222 shost=13fb166d-be40-4a37-9ca0-46d8239b22b8 to syslog
2021-11-24_09:01:16.70751 [Action Dispatcher] 2021/11/24 09:01:16 INFO - Received request with action get_task
2021-11-24_09:01:16.70755 [Action Dispatcher] 2021/11/24 09:01:16 DEBUG - Payload
2021-11-24_09:01:16.70756 ********************
2021-11-24_09:01:16.70756 {"protocol":3,"method":"get_task","arguments":["76eaa94d-129c-4885-5873-fe86ea6c4892"],"reply_to":"director.41c0f278-b82f-4fcd-a5ff-90bb27924de6.13fb166d-be40-4a37-9ca0-46d8239b22b8.fb9ea086-344d-46ad-aec4-2e6bd8a1f0e7"}
2021-11-24_09:01:16.70757 ********************
2021-11-24_09:01:16.70757 [Action Dispatcher] 2021/11/24 09:01:16 INFO - Running sync action get_task
2021-11-24_09:01:16.70757 [MBus Handler] 2021/11/24 09:01:16 INFO - Responding
2021-11-24_09:01:16.70758 [MBus Handler] 2021/11/24 09:01:16 DEBUG - Payload
2021-11-24_09:01:16.70758 ********************
2021-11-24_09:01:16.70758 {"value":{"agent_task_id":"76eaa94d-129c-4885-5873-fe86ea6c4892","state":"running"}}
2021-11-24_09:01:16.70758 ********************
2021-11-24_09:01:16.70840 [DelayedAuditLogger] 2021/11/24 09:01:16 DEBUG - Logging CEF:0|CloudFoundry|BOSH|1|agent_api|get_task|1|duser=director.41c0f278-b82f-4fcd-a5ff-90bb27924de6.13fb166d-be40-4a37-9ca0-46d8239b22b8.fb9ea086-344d-46ad-aec4-2e6bd8a1f0e7 src=10.164.169.217 spt=4222 shost=13fb166d-be40-4a37-9ca0-46d8239b22b8 to syslog
2021-11-24_09:01:17.71044 [Action Dispatcher] 2021/11/24 09:01:17 INFO - Received request with action get_task
2021-11-24_09:01:17.71048 [Action Dispatcher] 2021/11/24 09:01:17 DEBUG - Payload
2021-11-24_09:01:17.71048 ********************
2021-11-24_09:01:17.71049 {"protocol":3,"method":"get_task","arguments":["76eaa94d-129c-4885-5873-fe86ea6c4892"],"reply_to":"director.41c0f278-b82f-4fcd-a5ff-90bb27924de6.13fb166d-be40-4a37-9ca0-46d8239b22b8.462a3fc6-9cca-4998-8180-dc1b18984511"}
2021-11-24_09:01:17.71049 ********************
2021-11-24_09:01:17.71049 [Action Dispatcher] 2021/11/24 09:01:17 INFO - Running sync action get_task
2021-11-24_09:01:17.71050 [MBus Handler] 2021/11/24 09:01:17 INFO - Responding
2021-11-24_09:01:17.71050 [MBus Handler] 2021/11/24 09:01:17 DEBUG - Payload
2021-11-24_09:01:17.71050 ********************
2021-11-24_09:01:17.71051 {"value":{"agent_task_id":"76eaa94d-129c-4885-5873-fe86ea6c4892","state":"running"}}
2021-11-24_09:01:17.71051 ********************
2021-11-24_09:01:17.71101 [DelayedAuditLogger] 2021/11/24 09:01:17 DEBUG - Logging CEF:0|CloudFoundry|BOSH|1|agent_api|get_task|1|duser=director.41c0f278-b82f-4fcd-a5ff-90bb27924de6.13fb166d-be40-4a37-9ca0-46d8239b22b8.462a3fc6-9cca-4998-8180-dc1b18984511 src=10.164.169.217 spt=4222 shost=13fb166d-be40-4a37-9ca0-46d8239b22b8 to syslog
2021-11-24_09:01:18.71324 [Action Dispatcher] 2021/11/24 09:01:18 INFO - Received request with action get_task
2021-11-24_09:01:18.71329 [Action Dispatcher] 2021/11/24 09:01:18 DEBUG - Payload
2021-11-24_09:01:18.71332 ********************
2021-11-24_09:01:18.71333 {"protocol":3,"method":"get_task","arguments":["76eaa94d-129c-4885-5873-fe86ea6c4892"],"reply_to":"director.41c0f278-b82f-4fcd-a5ff-90bb27924de6.13fb166d-be40-4a37-9ca0-46d8239b22b8.bbcf7f81-c7b3-4e5b-b449-cdbf42d42cc0"}
2021-11-24_09:01:18.71333 ********************
2021-11-24_09:01:18.71334 [Action Dispatcher] 2021/11/24 09:01:18 INFO - Running sync action get_task
2021-11-24_09:01:18.71334 [MBus Handler] 2021/11/24 09:01:18 INFO - Responding
2021-11-24_09:01:18.71335 [MBus Handler] 2021/11/24 09:01:18 DEBUG - Payload
2021-11-24_09:01:18.71335 ********************
2021-11-24_09:01:18.71336 {"value":{"agent_task_id":"76eaa94d-129c-4885-5873-fe86ea6c4892","state":"running"}}
2021-11-24_09:01:18.71336 ********************
2021-11-24_09:01:18.71417 [DelayedAuditLogger] 2021/11/24 09:01:18 DEBUG - Logging CEF:0|CloudFoundry|BOSH|1|agent_api|get_task|1|duser=director.41c0f278-b82f-4fcd-a5ff-90bb27924de6.13fb166d-be40-4a37-9ca0-46d8239b22b8.bbcf7f81-c7b3-4e5b-b449-cdbf42d42cc0 src=10.164.169.217 spt=4222 shost=13fb166d-be40-4a37-9ca0-46d8239b22b8 to syslog
2021-11-24_09:01:19.71662 [Action Dispatcher] 2021/11/24 09:01:19 INFO - Received request with action get_task
2021-11-24_09:01:19.71667 [Action Dispatcher] 2021/11/24 09:01:19 DEBUG - Payload
2021-11-24_09:01:19.71667 ********************
2021-11-24_09:01:19.71667 {"protocol":3,"method":"get_task","arguments":["76eaa94d-129c-4885-5873-fe86ea6c4892"],"reply_to":"director.41c0f278-b82f-4fcd-a5ff-90bb27924de6.13fb166d-be40-4a37-9ca0-46d8239b22b8.8c3c0f89-839e-48c4-8d71-89cb3abeedf8"}
2021-11-24_09:01:19.71670 ********************
2021-11-24_09:01:19.71670 [Action Dispatcher] 2021/11/24 09:01:19 INFO - Running sync action get_task
2021-11-24_09:01:19.71671 [MBus Handler] 2021/11/24 09:01:19 INFO - Responding
2021-11-24_09:01:19.71671 [MBus Handler] 2021/11/24 09:01:19 DEBUG - Payload
2021-11-24_09:01:19.71672 ********************
2021-11-24_09:01:19.71672 {"value":{"agent_task_id":"76eaa94d-129c-4885-5873-fe86ea6c4892","state":"running"}}
2021-11-24_09:01:19.71673 ********************
2021-11-24_09:01:19.71773 [DelayedAuditLogger] 2021/11/24 09:01:19 DEBUG - Logging CEF:0|CloudFoundry|BOSH|1|agent_api|get_task|1|duser=director.41c0f278-b82f-4fcd-a5ff-90bb27924de6.13fb166d-be40-4a37-9ca0-46d8239b22b8.8c3c0f89-839e-48c4-8d71-89cb3abeedf8 src=10.164.169.217 spt=4222 shost=13fb166d-be40-4a37-9ca0-46d8239b22b8 to syslog
2021-11-24_09:01:19.84691 [Cmd Runner] 2021/11/24 09:01:19 DEBUG - Stdout: Restarting multipath-tools (via systemctl): multipath-tools.service.
2021-11-24_09:01:19.84693 [Cmd Runner] 2021/11/24 09:01:19 DEBUG - Stderr:
2021-11-24_09:01:19.84694 [Cmd Runner] 2021/11/24 09:01:19 DEBUG - Successful: true (0)
2021-11-24_09:01:19.84694 [OpenIscsiAdmin] 2021/11/24 09:01:19 INFO - Discovering lun against 10.201.110.118
2021-11-24_09:01:19.84696 [Cmd Runner] 2021/11/24 09:01:19 DEBUG - Running command 'iscsiadm -m discovery -t sendtargets -p 10.201.110.118'
2021-11-24_09:01:19.86360 [Cmd Runner] 2021/11/24 09:01:19 DEBUG - Stdout: 10.201.110.118:3260,1044 iqn.1992-08.com.netapp:stflon0203
2021-11-24_09:01:19.86361 10.201.110.119:3260,1047 iqn.1992-08.com.netapp:stflon0203
2021-11-24_09:01:19.86362 10.201.110.111:3260,1045 iqn.1992-08.com.netapp:stflon0203
2021-11-24_09:01:19.86362 10.201.110.114:3260,1043 iqn.1992-08.com.netapp:stflon0203
2021-11-24_09:01:19.86363 [Cmd Runner] 2021/11/24 09:01:19 DEBUG - Stderr:
2021-11-24_09:01:19.86363 [Cmd Runner] 2021/11/24 09:01:19 DEBUG - Successful: true (0)
2021-11-24_09:01:19.86364 [Cmd Runner] 2021/11/24 09:01:19 DEBUG - Running command 'iscsiadm -m session'
2021-11-24_09:01:19.87139 [Cmd Runner] 2021/11/24 09:01:19 DEBUG - Stdout: tcp: [3] 10.201.110.114:3260,1043 iqn.1992-08.com.netapp:stflon0203 (non-flash)
2021-11-24_09:01:19.87141 tcp: [4] 10.201.110.111:3260,1045 iqn.1992-08.com.netapp:stflon0203 (non-flash)
2021-11-24_09:01:19.87141 [Cmd Runner] 2021/11/24 09:01:19 DEBUG - Stderr:
2021-11-24_09:01:19.87142 [Cmd Runner] 2021/11/24 09:01:19 DEBUG - Successful: true (0)
2021-11-24_09:01:19.87142 [OpenIscsiAdmin] 2021/11/24 09:01:19 INFO - Iscsiadm session logout
2021-11-24_09:01:19.87143 [Cmd Runner] 2021/11/24 09:01:19 DEBUG - Running command 'iscsiadm -m node -u'
2021-11-24_09:01:19.89310 [Cmd Runner] 2021/11/24 09:01:19 DEBUG - Stdout: Logging out of session [sid: 3, target: iqn.1992-08.com.netapp:stflon0203, portal: 10.201.110.114,3260]
2021-11-24_09:01:19.89311 Logging out of session [sid: 4, target: iqn.1992-08.com.netapp:stflon0203, portal: 10.201.110.111,3260]
2021-11-24_09:01:19.89312 Logout of [sid: 3, target: iqn.1992-08.com.netapp:stflon0203, portal: 10.201.110.114,3260] successful.
2021-11-24_09:01:19.89313 Logout of [sid: 4, target: iqn.1992-08.com.netapp:stflon0203, portal: 10.201.110.111,3260] successful.
2021-11-24_09:01:19.89314 [Cmd Runner] 2021/11/24 09:01:19 DEBUG - Stderr:
2021-11-24_09:01:19.89314 [Cmd Runner] 2021/11/24 09:01:19 DEBUG - Successful: true (0)
2021-11-24_09:01:19.89315 [OpenIscsiAdmin] 2021/11/24 09:01:19 INFO - Iscsiadm session login
2021-11-24_09:01:19.89316 [Cmd Runner] 2021/11/24 09:01:19 DEBUG - Running command 'iscsiadm -m node -l'
2021-11-24_09:01:20.71956 [Action Dispatcher] 2021/11/24 09:01:20 INFO - Received request with action get_task
2021-11-24_09:01:20.71958 [Action Dispatcher] 2021/11/24 09:01:20 DEBUG - Payload
2021-11-24_09:01:20.71958 ********************
2021-11-24_09:01:20.71958 {"protocol":3,"method":"get_task","arguments":["76eaa94d-129c-4885-5873-fe86ea6c4892"],"reply_to":"director.41c0f278-b82f-4fcd-a5ff-90bb27924de6.13fb166d-be40-4a37-9ca0-46d8239b22b8.ca0eef26-e88f-42ef-8423-224d98d8c180"}
2021-11-24_09:01:20.71959 ********************
2021-11-24_09:01:20.71959 [Action Dispatcher] 2021/11/24 09:01:20 INFO - Running sync action get_task
2021-11-24_09:01:20.71959 [MBus Handler] 2021/11/24 09:01:20 INFO - Responding
2021-11-24_09:01:20.71960 [MBus Handler] 2021/11/24 09:01:20 DEBUG - Payload
2021-11-24_09:01:20.71960 ********************
2021-11-24_09:01:20.71960 {"value":{"agent_task_id":"76eaa94d-129c-4885-5873-fe86ea6c4892","state":"running"}}
2021-11-24_09:01:20.71961 ********************
2021-11-24_09:01:20.72033 [DelayedAuditLogger] 2021/11/24 09:01:20 DEBUG - Logging CEF:0|CloudFoundry|BOSH|1|agent_api|get_task|1|duser=director.41c0f278-b82f-4fcd-a5ff-90bb27924de6.13fb166d-be40-4a37-9ca0-46d8239b22b8.ca0eef26-e88f-42ef-8423-224d98d8c180 src=10.164.169.217 spt=4222 shost=13fb166d-be40-4a37-9ca0-46d8239b22b8 to syslog
2021-11-24_09:01:20.97494 [Cmd Runner] 2021/11/24 09:01:20 DEBUG - Stdout: Logging in to [iface: default, target: iqn.1992-08.com.netapp:stflon0203, portal: 10.201.110.118,3260] (multiple)
2021-11-24_09:01:20.97495 Logging in to [iface: default, target: iqn.1992-08.com.netapp:stflon0203, portal: 10.201.110.119,3260] (multiple)
2021-11-24_09:01:20.97496 Logging in to [iface: default, target: iqn.1992-08.com.netapp:stflon0203, portal: 10.201.110.114,3260] (multiple)
2021-11-24_09:01:20.97496 Logging in to [iface: default, target: iqn.1992-08.com.netapp:stflon0203, portal: 10.201.110.111,3260] (multiple)
2021-11-24_09:01:20.97497 Login to [iface: default, target: iqn.1992-08.com.netapp:stflon0203, portal: 10.201.110.118,3260] successful.
2021-11-24_09:01:20.97497 Login to [iface: default, target: iqn.1992-08.com.netapp:stflon0203, portal: 10.201.110.119,3260] successful.
2021-11-24_09:01:20.97498 Login to [iface: default, target: iqn.1992-08.com.netapp:stflon0203, portal: 10.201.110.114,3260] successful.
2021-11-24_09:01:20.97498 Login to [iface: default, target: iqn.1992-08.com.netapp:stflon0203, portal: 10.201.110.111,3260] successful.
2021-11-24_09:01:20.97500 [Cmd Runner] 2021/11/24 09:01:20 DEBUG - Stderr:
2021-11-24_09:01:20.97520 [Cmd Runner] 2021/11/24 09:01:20 DEBUG - Successful: true (0)
2021-11-24_09:01:20.97522 [iscsiResolver] 2021/11/24 09:01:20 DEBUG - Waiting for iSCSI device to appear
2021-11-24_09:01:20.97523 [Cmd Runner] 2021/11/24 09:01:20 DEBUG - Running command 'dmsetup ls'
2021-11-24_09:01:20.97781 [Cmd Runner] 2021/11/24 09:01:20 DEBUG - Stdout: 3600a098038305679445d523053437757 (253:0)
2021-11-24_09:01:20.97782 3600a098038305679445d523053437757-part1 (253:1)
2021-11-24_09:01:20.97783 [Cmd Runner] 2021/11/24 09:01:20 DEBUG - Stderr:
2021-11-24_09:01:20.97783 [Cmd Runner] 2021/11/24 09:01:20 DEBUG - Successful: true (0)
2021-11-24_09:01:20.97783 [iscsiResolver] 2021/11/24 09:01:20 DEBUG - devices: '[3600a098038305679445d523053437757 (253:0) 3600a098038305679445d523053437757-part1 (253:1)]'
2021-11-24_09:01:20.97784 [iscsiResolver] 2021/11/24 09:01:20 DEBUG - path in device list: '/dev/mapper/3600a098038305679445d523053437757'
2021-11-24_09:01:21.72233 [Action Dispatcher] 2021/11/24 09:01:21 INFO - Received request with action get_task
2021-11-24_09:01:25.97875 [Cmd Runner] 2021/11/24 09:01:25 DEBUG - Running command 'dmsetup ls'
2021-11-24_09:01:25.98105 [Cmd Runner] 2021/11/24 09:01:25 DEBUG - Stdout: 3600a098038305678762b523053333956 (253:2)
2021-11-24_09:01:25.98108 3600a098038305679445d523053437757 (253:0)
2021-11-24_09:01:25.98108 3600a098038305679445d523053437757-part1 (253:1)
2021-11-24_09:01:25.98109 [Cmd Runner] 2021/11/24 09:01:25 DEBUG - Stderr:
2021-11-24_09:01:25.98109 [Cmd Runner] 2021/11/24 09:01:25 DEBUG - Successful: true (0)
2021-11-24_09:01:25.98110 [iscsiResolver] 2021/11/24 09:01:25 DEBUG - devices: '[3600a098038305678762b523053333956 (253:2) 3600a098038305679445d523053437757 (253:0) 3600a098038305679445d523053437757-part1 (253:1)]'
2021-11-24_09:01:25.98111 [iscsiResolver] 2021/11/24 09:01:25 DEBUG - path in device list: '/dev/mapper/3600a098038305678762b523053333956'
2021-11-24_09:01:25.98111 [iscsiResolver] 2021/11/24 09:01:25 DEBUG - path in device list: '/dev/mapper/3600a098038305679445d523053437757'
2021-11-24_09:01:25.98119 [iscsiResolver] 2021/11/24 09:01:25 INFO - Found real path '/dev/mapper/3600a098038305678762b523053333956'
2021-11-24_09:01:25.98121 [Cmd Runner] 2021/11/24 09:01:25 DEBUG - Running command 'parted -m /dev/mapper/3600a098038305678762b523053333956 unit B print'
2021-11-24_09:01:25.99605 [Cmd Runner] 2021/11/24 09:01:25 DEBUG - Stdout: ^M ^MBYT;
2021-11-24_09:01:25.99607 /dev/mapper/3600a098038305678762b523053333956:42949672960B:dm:512:4096:unknown:Linux device-mapper (multipath):;
2021-11-24_09:01:25.99607 [Cmd Runner] 2021/11/24 09:01:25 DEBUG - Stderr: Error: /dev/mapper/3600a098038305678762b523053333956: unrecognised disk label
2021-11-24_09:01:25.99608 [Cmd Runner] 2021/11/24 09:01:25 DEBUG - Successful: true (0)
2021-11-24_09:01:25.99608 [Cmd Runner] 2021/11/24 09:01:25 DEBUG - Running command 'parted -s /dev/mapper/3600a098038305678762b523053333956 mklabel gpt'
2021-11-24_09:01:26.06443 [Cmd Runner] 2021/11/24 09:01:26 DEBUG - Stdout:
2021-11-24_09:01:26.06445 [Cmd Runner] 2021/11/24 09:01:26 DEBUG - Stderr:
2021-11-24_09:01:26.06446 [Cmd Runner] 2021/11/24 09:01:26 DEBUG - Successful: true (0)
2021-11-24_09:01:26.06446 [Cmd Runner] 2021/11/24 09:01:26 DEBUG - Running command 'parted -m /dev/mapper/3600a098038305678762b523053333956 unit B print'
2021-11-24_09:01:26.07284 [Cmd Runner] 2021/11/24 09:01:26 DEBUG - Stdout: BYT;
2021-11-24_09:01:26.07286 /dev/mapper/3600a098038305678762b523053333956:42949672960B:dm:512:4096:gpt:Linux device-mapper (multipath):;
2021-11-24_09:01:26.07287 [Cmd Runner] 2021/11/24 09:01:26 DEBUG - Stderr:
2021-11-24_09:01:26.07287 [Cmd Runner] 2021/11/24 09:01:26 DEBUG - Successful: true (0)
2021-11-24_09:01:26.07288 [Cmd Runner] 2021/11/24 09:01:26 DEBUG - Running command 'udevadm settle'
2021-11-24_09:01:26.12912 [Cmd Runner] 2021/11/24 09:01:26 DEBUG - Stdout:
2021-11-24_09:01:26.12917 [Cmd Runner] 2021/11/24 09:01:26 DEBUG - Stderr:
2021-11-24_09:01:26.12925 [Cmd Runner] 2021/11/24 09:01:26 DEBUG - Successful: true (0)
2021-11-24_09:01:26.12926 [linuxPlatform] 2021/11/24 09:01:26 DEBUG - Persistent disk single partition needs resize: false
2021-11-24_09:01:26.12928 [Cmd Runner] 2021/11/24 09:01:26 DEBUG - Running command 'partprobe /dev/mapper/3600a098038305678762b523053333956'
2021-11-24_09:01:26.23379 [Cmd Runner] 2021/11/24 09:01:26 DEBUG - Stdout:
2021-11-24_09:01:26.23384 [Cmd Runner] 2021/11/24 09:01:26 DEBUG - Stderr:
2021-11-24_09:01:26.23385 [Cmd Runner] 2021/11/24 09:01:26 DEBUG - Successful: true (0)
2021-11-24_09:01:26.23396 [Cmd Runner] 2021/11/24 09:01:26 DEBUG - Running command 'parted -m /dev/mapper/3600a098038305678762b523053333956 unit B print'
2021-11-24_09:01:26.24561 [Cmd Runner] 2021/11/24 09:01:26 DEBUG - Stdout: BYT;
2021-11-24_09:01:26.24563 /dev/mapper/3600a098038305678762b523053333956:42949672960B:dm:512:4096:gpt:Linux device-mapper (multipath):;
2021-11-24_09:01:26.24564 [Cmd Runner] 2021/11/24 09:01:26 DEBUG - Stderr:
2021-11-24_09:01:26.24565 [Cmd Runner] 2021/11/24 09:01:26 DEBUG - Successful: true (0)
2021-11-24_09:01:26.24565 [Cmd Runner] 2021/11/24 09:01:26 DEBUG - Running command 'udevadm settle'
2021-11-24_09:01:26.30127 [Cmd Runner] 2021/11/24 09:01:26 DEBUG - Stdout:
2021-11-24_09:01:26.30129 [Cmd Runner] 2021/11/24 09:01:26 DEBUG - Stderr:
2021-11-24_09:01:26.30130 [Cmd Runner] 2021/11/24 09:01:26 DEBUG - Successful: true (0)
2021-11-24_09:01:26.30131 [attemptRetryStrategy] 2021/11/24 09:01:26 DEBUG - Making attempt #0
2021-11-24_09:01:26.30131 [Cmd Runner] 2021/11/24 09:01:26 DEBUG - Running command 'parted -s /dev/mapper/3600a098038305678762b523053333956 unit B mkpart bosh-partition-0 1048576 42948624383'
2021-11-24_09:01:26.42637 [Cmd Runner] 2021/11/24 09:01:26 DEBUG - Stdout:
2021-11-24_09:01:26.42640 [Cmd Runner] 2021/11/24 09:01:26 DEBUG - Stderr: device-mapper: create ioctl on 3600a098038305678762b523053333956p1 part1-mpath-3600a098038305678762b523053333956 failed: Device or resource busy
2021-11-24_09:01:26.42641 [Cmd Runner] 2021/11/24 09:01:26 DEBUG - Successful: true (0)
2021-11-24_09:01:26.42642 [Cmd Runner] 2021/11/24 09:01:26 DEBUG - Running command 'partprobe /dev/mapper/3600a098038305678762b523053333956'
2021-11-24_09:01:26.56172 [Cmd Runner] 2021/11/24 09:01:26 DEBUG - Stdout:
2021-11-24_09:01:26.56180 [Cmd Runner] 2021/11/24 09:01:26 DEBUG - Stderr: device-mapper: create ioctl on 3600a098038305678762b523053333956p1 part1-mpath-3600a098038305678762b523053333956 failed: Device or resource busy
2021-11-24_09:01:26.56180 [Cmd Runner] 2021/11/24 09:01:26 DEBUG - Successful: true (0)
2021-11-24_09:01:26.56181 [Cmd Runner] 2021/11/24 09:01:26 DEBUG - Running command 'udevadm settle'
2021-11-24_09:01:26.65747 [Cmd Runner] 2021/11/24 09:01:26 DEBUG - Stdout:
2021-11-24_09:01:26.65751 [Cmd Runner] 2021/11/24 09:01:26 DEBUG - Stderr:
2021-11-24_09:01:26.65751 [Cmd Runner] 2021/11/24 09:01:26 DEBUG - Successful: true (0)
2021-11-24_09:01:26.65752 [PartedPartitioner] 2021/11/24 09:01:26 INFO - Successfully created partition 0 on /dev/mapper/3600a098038305678762b523053333956
2021-11-24_09:01:26.65759 [Cmd Runner] 2021/11/24 09:01:26 DEBUG - Running command '/etc/init.d/open-iscsi restart'
2021-11-24_09:01:26.73938 [Action Dispatcher] 2021/11/24 09:01:26 INFO - Received request with action get_task
2021-11-24_09:01:26.73940 [Action Dispatcher] 2021/11/24 09:01:26 DEBUG - Payload
2021-11-24_09:01:26.73941 ********************
2021-11-24_09:01:26.73941 {"protocol":3,"method":"get_task","arguments":["76eaa94d-129c-4885-5873-fe86ea6c4892"],"reply_to":"director.41c0f278-b82f-4fcd-a5ff-90bb27924de6.13fb166d-be40-4a37-9ca0-46d8239b22b8.cdf96840-e7b2-4f0b-a990-7dd10a76445a"}
2021-11-24_09:01:26.73942 ********************
2021-11-24_09:01:26.73942 [Action Dispatcher] 2021/11/24 09:01:26 INFO - Running sync action get_task
2021-11-24_09:01:26.74297 [MBus Handler] 2021/11/24 09:01:26 INFO - Responding
2021-11-24_09:01:26.74299 [MBus Handler] 2021/11/24 09:01:26 DEBUG - Payload
2021-11-24_09:01:26.74299 ********************
2021-11-24_09:01:26.74300 {"value":{"agent_task_id":"76eaa94d-129c-4885-5873-fe86ea6c4892","state":"running"}}
2021-11-24_09:01:26.74300 ********************
2021-11-24_09:01:26.74301 [DelayedAuditLogger] 2021/11/24 09:01:26 DEBUG - Logging CEF:0|CloudFoundry|BOSH|1|agent_api|get_task|1|duser=director.41c0f278-b82f-4fcd-a5ff-90bb27924de6.13fb166d-be40-4a37-9ca0-46d8239b22b8.cdf96840-e7b2-4f0b-a990-7dd10a76445a src=10.164.169.217 spt=4222 shost=13fb166d-be40-4a37-9ca0-46d8239b22b8 to syslog
2021-11-24_09:01:27.72906 [monitJobSupervisor] 2021/11/24 09:01:27 DEBUG - Getting monit status
2021-11-24_09:01:27.72909 [http-client] 2021/11/24 09:01:27 DEBUG - status function called
2021-11-24_09:01:27.72909 [http-client] 2021/11/24 09:01:27 DEBUG - Monit request: url='http://127.0.0.1:2822/_status2?format=xml' body=''
2021-11-24_09:01:27.72909 [attemptRetryStrategy] 2021/11/24 09:01:27 DEBUG - Making attempt #0 for *httpclient.RequestRetryable
2021-11-24_09:01:27.72910 [clientRetryable] 2021/11/24 09:01:27 DEBUG - [requestID=445ff246-9e43-498d-5ea9-f1a28cdeaa09] Requesting (attempt=1): Request{ Method: 'GET', URL: 'http://127.0.0.1:2822/_status2?format=xml' }
2021-11-24_09:01:27.73098 [http-client] 2021/11/24 09:01:27 DEBUG - Unmarshalled Monit status: {XMLName:{Space: Local:service} Name:system_13fb166d-be40-4a37-9ca0-46d8239b22b8 Pending:0 Status:0 StatusMessage: Monitor:1 Uptime:0 Children:0 Memory:{XMLName:{Space: Local:} Percent:0 PercentTotal:0 Kilobyte:0 KilobyteTotal:0} CPU:{XMLName:{Space: Local:} Percent:0 PercentTotal:0}}
2021-11-24_09:01:27.73099 [File System] 2021/11/24 09:01:27 DEBUG - Checking if file exists /var/vcap/monit/stopped
2021-11-24_09:01:27.73100 [File System] 2021/11/24 09:01:27 DEBUG - Stat '/var/vcap/monit/stopped'
2021-11-24_09:01:27.73100 [agent] 2021/11/24 09:01:27 DEBUG - Building heartbeat
2021-11-24_09:01:27.73100 [File System] 2021/11/24 09:01:27 DEBUG - Reading file /proc/mounts
2021-11-24_09:01:27.73101 [File System] 2021/11/24 09:01:27 DEBUG - Read content
2021-11-24_09:01:27.73101 ********************
2021-11-24_09:01:27.73101 sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0
2021-11-24_09:01:27.73102 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0
2021-11-24_09:01:27.73102 udev /dev devtmpfs rw,nosuid,relatime,size=1980932k,nr_inodes=495233,mode=755 0 0
2021-11-24_09:01:27.73102 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0
2021-11-24_09:01:27.73103 tmpfs /run tmpfs rw,nosuid,noexec,relatime,size=401188k,mode=755 0 0
2021-11-24_09:01:27.73104 /dev/xvda2 / ext4 rw,relatime 0 0
2021-11-24_09:01:27.73104 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0
2021-11-24_09:01:27.73105 tmpfs /dev/shm tmpfs rw,nosuid,nodev,noexec 0 0
2021-11-24_09:01:27.73105 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0
2021-11-24_09:01:27.73109 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0
2021-11-24_09:01:27.73109 cgroup /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0
2021-11-24_09:01:27.73110 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0
2021-11-24_09:01:27.73110 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0
2021-11-24_09:01:27.73111 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0
2021-11-24_09:01:27.73111 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0
2021-11-24_09:01:27.73111 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0
2021-11-24_09:01:27.73112 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0
2021-11-24_09:01:27.73112 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0
2021-11-24_09:01:27.73112 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0
2021-11-24_09:01:27.73114 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0
2021-11-24_09:01:27.73114 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0
2021-11-24_09:01:27.73114 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0
2021-11-24_09:01:27.73115 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0
2021-11-24_09:01:27.73115 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0
2021-11-24_09:01:27.73115 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18335 0 0
2021-11-24_09:01:27.73115 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0
2021-11-24_09:01:27.73116 mqueue /dev/mqueue mqueue rw,relatime 0 0
2021-11-24_09:01:27.73116 debugfs /sys/kernel/debug debugfs rw,relatime 0 0
2021-11-24_09:01:27.73116 configfs /sys/kernel/config configfs rw,relatime 0 0
2021-11-24_09:01:27.73117 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0
2021-11-24_09:01:27.73117 /dev/xvda1 /boot ext4 rw,relatime 0 0
2021-11-24_09:01:27.73117 /dev/xvdc2 /var/vcap/data ext4 rw,relatime 0 0
2021-11-24_09:01:27.73118 /dev/xvdc2 /var/log ext4 rw,nosuid,nodev,noexec,relatime 0 0
2021-11-24_09:01:27.73118 tmpfs /var/vcap/data/sys/run tmpfs rw,relatime,size=16384k 0 0
2021-11-24_09:01:27.73119 /dev/xvdc2 /tmp ext4 rw,nosuid,nodev,noexec,relatime 0 0
2021-11-24_09:01:27.73119 /dev/xvdc2 /var/tmp ext4 rw,nosuid,nodev,noexec,relatime 0 0
2021-11-24_09:01:27.73120 /dev/xvda2 /home ext4 rw,nodev,relatime 0 0
2021-11-24_09:01:27.73120 /dev/mapper/3600a098038305679445d523053437757-part1 /var/vcap/store ext4 rw,relatime,stripe=16 0 0
2021-11-24_09:01:27.73120 tmpfs /run/user/1001 tmpfs rw,nosuid,nodev,relatime,size=401184k,mode=700,uid=1001,gid=1003 0 0
2021-11-24_09:01:27.73121
2021-11-24_09:01:27.73121 ********************
2021-11-24_09:01:47.04357 [Cmd Runner] 2021/11/24 09:01:47 DEBUG - Stdout: Restarting multipath-tools (via systemctl): multipath-tools.service.
2021-11-24_09:01:47.04359 [Cmd Runner] 2021/11/24 09:01:47 DEBUG - Stderr:
2021-11-24_09:01:47.04359 [Cmd Runner] 2021/11/24 09:01:47 DEBUG - Successful: true (0)
2021-11-24_09:01:47.04360 [attemptRetryStrategy] 2021/11/24 09:01:47 DEBUG - Making attempt #0
2021-11-24_09:01:47.04362 [Cmd Runner] 2021/11/24 09:01:47 DEBUG - Running command 'dmsetup ls'
2021-11-24_09:01:47.04960 [Cmd Runner] 2021/11/24 09:01:47 DEBUG - Stdout: 3600a098038305678762b523053333956 (253:2)
2021-11-24_09:01:47.04962 3600a098038305678762b523053333956-part1 (253:3)
2021-11-24_09:01:47.04962 3600a098038305679445d523053437757 (253:0)
2021-11-24_09:01:47.04963 3600a098038305679445d523053437757-part1 (253:1)
2021-11-24_09:01:47.04963 [Cmd Runner] 2021/11/24 09:01:47 DEBUG - Stderr:
2021-11-24_09:01:47.04964 [Cmd Runner] 2021/11/24 09:01:47 DEBUG - Successful: true (0)
2021-11-24_09:01:47.04978 [PartedPartitioner] 2021/11/24 09:01:47 INFO - Succeeded in detecting partition /dev/mapper/3600a098038305678762b523053333956-part1
2021-11-24_09:01:47.04979 [Cmd Runner] 2021/11/24 09:01:47 DEBUG - Running command 'blkid -p /dev/mapper/3600a098038305678762b523053333956-part1'
2021-11-24_09:01:47.06927 [Cmd Runner] 2021/11/24 09:01:47 DEBUG - Stdout: /dev/mapper/3600a098038305678762b523053333956-part1: PART_ENTRY_SCHEME="gpt" PART_ENTRY_NAME="bosh-partition-0" PART_ENTRY_UUID="7168b655-c49e-4832-b30e-f048f38808ca" PART_ENTRY_TYPE="0fc63daf-8483-4772-8e79-3d69d8477de4" PART_ENTRY_NUMBER="1" PART_ENTRY_OFFSET="2048" PART_ENTRY_SIZE="83881984" PART_ENTRY_DISK="253:2"
2021-11-24_09:01:47.06929 [Cmd Runner] 2021/11/24 09:01:47 DEBUG - Stderr:
2021-11-24_09:01:47.06929 [Cmd Runner] 2021/11/24 09:01:47 DEBUG - Successful: true (0)
2021-11-24_09:01:47.06930 [File System] 2021/11/24 09:01:47 DEBUG - Checking if file exists /sys/fs/ext4/features/lazy_itable_init
2021-11-24_09:01:47.06944 [File System] 2021/11/24 09:01:47 DEBUG - Stat '/sys/fs/ext4/features/lazy_itable_init'
2021-11-24_09:01:47.06946 [Cmd Runner] 2021/11/24 09:01:47 DEBUG - Running command 'mke2fs -t ext4 -j -E lazy_itable_init=1 /dev/mapper/3600a098038305678762b523053333956-part1'
2021-11-24_09:01:49.17613 [Cmd Runner] 2021/11/24 09:01:49 DEBUG - Stdout: Creating filesystem with 10485248 4k blocks and 2621440 inodes
2021-11-24_09:01:49.17624 Filesystem UUID: 7188549f-bc5d-4dbd-ac91-d0807041e7b0
2021-11-24_09:01:49.17625 Superblock backups stored on blocks:
2021-11-24_09:01:49.17625 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208,
2021-11-24_09:01:49.17626 4096000, 7962624
2021-11-24_09:01:49.17626
2021-11-24_09:01:49.17627 Allocating group tables: 0/320^H^H^H^H^H^H^H ^H^H^H^H^H^H^Hdone
2021-11-24_09:01:49.17627 Writing inode tables: 0/320^H^H^H^H^H^H^H ^H^H^H^H^H^H^Hdone
2021-11-24_09:01:49.17628 Creating journal (65536 blocks): done
2021-11-24_09:01:49.17628 Writing superblocks and filesystem accounting information: 0/320^H^H^H^H^H^H^H ^H^H^H^H^H^H^Hdone
2021-11-24_09:01:49.17629
2021-11-24_09:01:49.17629 [Cmd Runner] 2021/11/24 09:01:49 DEBUG - Stderr: mke2fs 1.44.1 (24-Mar-2018)
2021-11-24_09:01:49.17629 [Cmd Runner] 2021/11/24 09:01:49 DEBUG - Successful: true (0)
2021-11-24_09:01:49.17630 [linuxPlatform] 2021/11/24 09:01:49 DEBUG - Mounting persistent disk {ID:299719082 DeviceID:299719082 VolumeID: Lun: HostDeviceID: Path: ISCSISettings:{InitiatorName:iqn.2021-11.zzzzz
:xxxx Username:xxxx Target:10.201.110.118 Password:yyyyy} FileSystemType: MountOptions:[] Partitioner:} at /var/vcap/store
2021-11-24_09:01:49.17641 [multipathDevicePathResolver] 2021/11/24 09:01:49 DEBUG - Failed to get device real path by disk ID: '299719082'. Error: 'Getting real device path: path is missing', timeout: 'false'
2021-11-24_09:01:49.17642 [multipathDevicePathResolver] 2021/11/24 09:01:49 DEBUG - Using iSCSI resolver to get device real path
2021-11-24_09:01:49.17643 [File System] 2021/11/24 09:01:49 DEBUG - Checking if file exists /var/vcap/bosh/managed_disk_settings.json
2021-11-24_09:01:49.17643 [File System] 2021/11/24 09:01:49 DEBUG - Stat '/var/vcap/bosh/managed_disk_settings.json'
2021-11-24_09:01:49.17644 [File System] 2021/11/24 09:01:49 DEBUG - Reading file /var/vcap/bosh/managed_disk_settings.json
2021-11-24_09:01:49.17644 [File System] 2021/11/24 09:01:49 DEBUG - Read content
2021-11-24_09:01:49.17645 ********************
2021-11-24_09:01:49.17645 299482396
2021-11-24_09:01:49.17645 ********************
2021-11-24_09:01:49.17646 [iscsiResolver] 2021/11/24 09:01:49 DEBUG - Last mounted disk CID: '299482396'
2021-11-24_09:01:49.17650 [Cmd Runner] 2021/11/24 09:01:49 DEBUG - Running command 'dmsetup ls'
2021-11-24_09:01:49.17908 [Cmd Runner] 2021/11/24 09:01:49 DEBUG - Stdout: 3600a098038305678762b523053333956 (253:2)
2021-11-24_09:01:49.17909 3600a098038305678762b523053333956-part1 (253:3)
2021-11-24_09:01:49.17910 3600a098038305679445d523053437757 (253:0)
2021-11-24_09:01:49.17910 3600a098038305679445d523053437757-part1 (253:1)
2021-11-24_09:01:49.17911 [Cmd Runner] 2021/11/24 09:01:49 DEBUG - Stderr:
2021-11-24_09:01:49.17911 [Cmd Runner] 2021/11/24 09:01:49 DEBUG - Successful: true (0)
2021-11-24_09:01:49.17926 [iscsiResolver] 2021/11/24 09:01:49 DEBUG - devices: '[3600a098038305678762b523053333956 (253:2) 3600a098038305678762b523053333956-part1 (253:3) 3600a098038305679445d523053437757 (253:0) 3600a098038305679445d523053437757-part1 (253:1)]'
2021-11-24_09:01:49.17927 [iscsiResolver] 2021/11/24 09:01:49 DEBUG - path in device list: '/dev/mapper/3600a098038305678762b523053333956'
2021-11-24_09:01:49.17927 [iscsiResolver] 2021/11/24 09:01:49 DEBUG - path in device list: '/dev/mapper/3600a098038305679445d523053437757'
2021-11-24_09:01:49.17929 [iscsiResolver] 2021/11/24 09:01:49 DEBUG - Existing real paths '[/dev/mapper/3600a098038305678762b523053333956 /dev/mapper/3600a098038305679445d523053437757]'
2021-11-24_09:01:49.17930 [OpenIscsiAdmin] 2021/11/24 09:01:49 INFO - Setup Open-iscsi, initializing /etc/iscsi/initiatorname.iscsi,iscsid.conf
2021-11-24_09:01:56.29739 [iscsiResolver] 2021/11/24 09:01:56 DEBUG - Waiting for iSCSI device to appear
2021-11-24_09:01:56.29739 [Cmd Runner] 2021/11/24 09:01:56 DEBUG - Running command 'dmsetup ls'
2021-11-24_09:01:56.30006 [Cmd Runner] 2021/11/24 09:01:56 DEBUG - Stdout: 3600a098038305678762b523053333956 (253:2)
2021-11-24_09:01:56.30008 3600a098038305678762b523053333956-part1 (253:3)
2021-11-24_09:01:56.30008 3600a098038305679445d523053437757 (253:0)
2021-11-24_09:01:56.30009 3600a098038305679445d523053437757-part1 (253:1)
2021-11-24_09:01:56.30009 [Cmd Runner] 2021/11/24 09:01:56 DEBUG - Stderr:
2021-11-24_09:01:56.30010 [Cmd Runner] 2021/11/24 09:01:56 DEBUG - Successful: true (0)
2021-11-24_09:01:56.30010 [iscsiResolver] 2021/11/24 09:01:56 DEBUG - devices: '[3600a098038305678762b523053333956 (253:2) 3600a098038305678762b523053333956-part1 (253:3) 3600a098038305679445d523053437757 (253:0) 3600a098038305679445d523053437757-part1 (253:1)]'
2021-11-24_09:01:56.30011 [iscsiResolver] 2021/11/24 09:01:56 DEBUG - path in device list: '/dev/mapper/3600a098038305678762b523053333956'
2021-11-24_09:01:56.30012 [iscsiResolver] 2021/11/24 09:01:56 DEBUG - path in device list: '/dev/mapper/3600a098038305679445d523053437757'
2021-11-24_09:01:57.73118 [File System] 2021/11/24 09:01:57 DEBUG - Reading file /proc/mounts
2021-11-24_09:01:57.73119 [File System] 2021/11/24 09:01:57 DEBUG - Read content
2021-11-24_09:01:57.73119 ********************
2021-11-24_09:01:57.73120 sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0
2021-11-24_09:01:57.73121 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0
2021-11-24_09:01:57.73121 udev /dev devtmpfs rw,nosuid,relatime,size=1980932k,nr_inodes=495233,mode=755 0 0
2021-11-24_09:01:57.73122 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0
2021-11-24_09:01:57.73122 tmpfs /run tmpfs rw,nosuid,noexec,relatime,size=401188k,mode=755 0 0
2021-11-24_09:01:57.73124 /dev/xvda2 / ext4 rw,relatime 0 0
2021-11-24_09:01:57.73125 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0
2021-11-24_09:01:57.73125 tmpfs /dev/shm tmpfs rw,nosuid,nodev,noexec 0 0
2021-11-24_09:01:57.73127 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0
2021-11-24_09:01:57.73128 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0
2021-11-24_09:01:57.73128 cgroup /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0
2021-11-24_09:01:57.73128 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0
2021-11-24_09:01:57.73129 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0
2021-11-24_09:01:57.73129 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0
2021-11-24_09:01:57.73129 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0
2021-11-24_09:01:57.73130 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0
2021-11-24_09:01:57.73130 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0
2021-11-24_09:01:57.73130 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0
2021-11-24_09:01:57.73131 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0
2021-11-24_09:01:57.73132 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0
2021-11-24_09:01:57.73132 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0
2021-11-24_09:01:57.73133 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0
2021-11-24_09:01:57.73133 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0
2021-11-24_09:01:57.73133 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0
2021-11-24_09:01:57.73133 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18335 0 0
2021-11-24_09:01:57.73134 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0
2021-11-24_09:01:57.73134 mqueue /dev/mqueue mqueue rw,relatime 0 0
2021-11-24_09:01:57.73134 debugfs /sys/kernel/debug debugfs rw,relatime 0 0
2021-11-24_09:01:57.73135 configfs /sys/kernel/config configfs rw,relatime 0 0
2021-11-24_09:01:57.73135 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0
2021-11-24_09:01:57.73136 /dev/xvda1 /boot ext4 rw,relatime 0 0
2021-11-24_09:01:57.73136 /dev/xvdc2 /var/vcap/data ext4 rw,relatime 0 0
2021-11-24_09:01:57.73137 /dev/xvdc2 /var/log ext4 rw,nosuid,nodev,noexec,relatime 0 0
2021-11-24_09:01:57.73137 tmpfs /var/vcap/data/sys/run tmpfs rw,relatime,size=16384k 0 0
2021-11-24_09:01:57.73140 /dev/xvdc2 /tmp ext4 rw,nosuid,nodev,noexec,relatime 0 0
2021-11-24_09:01:57.73142 /dev/xvdc2 /var/tmp ext4 rw,nosuid,nodev,noexec,relatime 0 0
2021-11-24_09:01:57.73143 /dev/xvda2 /home ext4 rw,nodev,relatime 0 0
2021-11-24_09:01:57.73143 /dev/mapper/3600a098038305679445d523053437757-part1 /var/vcap/store ext4 rw,relatime,stripe=16 0 0
2021-11-24_09:01:57.73143 tmpfs /run/user/1001 tmpfs rw,nosuid,nodev,relatime,size=401184k,mode=700,uid=1001,gid=1003 0 0
2021-11-24_09:01:57.73144
2021-11-24_09:01:57.73144 ********************
2021-11-24_09:02:01.30064 [Cmd Runner] 2021/11/24 09:02:01 DEBUG - Running command 'dmsetup ls'
2021-11-24_09:02:01.30284 [Cmd Runner] 2021/11/24 09:02:01 DEBUG - Stdout: 3600a098038305678762b523053333956 (253:2)
2021-11-24_09:02:01.30286 3600a098038305678762b523053333956-part1 (253:3)
2021-11-24_09:02:01.30287 3600a098038305679445d523053437757 (253:0)
2021-11-24_09:02:01.30287 3600a098038305679445d523053437757-part1 (253:1)
2021-11-24_09:02:01.30288 [Cmd Runner] 2021/11/24 09:02:01 DEBUG - Stderr:
2021-11-24_09:02:01.30288 [Cmd Runner] 2021/11/24 09:02:01 DEBUG - Successful: true (0)
2021-11-24_09:02:01.30297 [iscsiResolver] 2021/11/24 09:02:01 DEBUG - devices: '[3600a098038305678762b523053333956 (253:2) 3600a098038305678762b523053333956-part1 (253:3) 3600a098038305679445d523053437757 (253:0) 3600a098038305679445d523053437757-part1 (253:1)]'
2021-11-24_09:02:01.30299 [iscsiResolver] 2021/11/24 09:02:01 DEBUG - path in device list: '/dev/mapper/3600a098038305678762b523053333956'
2021-11-24_09:02:01.30299 [iscsiResolver] 2021/11/24 09:02:01 DEBUG - path in device list: '/dev/mapper/3600a098038305679445d523053437757'
2021-11-24_09:02:46.32948 [Task Service] 2021/11/24 09:02:46 ERROR - Failed processing task #76eaa94d-129c-4885-5873-fe86ea6c4892 got: Mounting persistent disk: Getting real device path: Resolving mapped device path: get device path after connect iSCSI target: Timed out to get real iSCSI device path
from bosh-agent.
bgandon
commented on June 30, 2024
I realise that when migrating the persistent disk, the algorithm for detecting the new disk can only work once, and only before the device is partitioned. Because the presence of a partition is key to select the correct device, when there are two of them.
I'm not sure how we could have GetRealDevicePath() behave consistently when called before/after disk partitioning. I'm only thinking of a cache for remembering the DiskID-DevicePath associations.
from bosh-agent.
donacarr
commented on June 30, 2024
Hi @bgandon sorry to annoying but we need really to make progress here.
We are blocked right now and we need to create the new stemcell to deploy in our cloud env.
Please consider also the option to rollback the #244 until we have a fix.
As I wrote https://cloudfoundry.slack.com/archives/C01C7V4U79U/p1638285634005700?thread_ts=1637167965.001500&cid=C01C7V4U79U we are happy to make a call to speed up the solution.
from bosh-agent.
rkoster
commented on June 30, 2024
@bgandon has any progress been made on this in the meantime?
from bosh-agent.
bgandon
commented on June 30, 2024
I've just pushed some new tests and fixed in #253, that should fix the issue that has been identified.
from bosh-agent.
bosh-admin-bot
commented on June 30, 2024
This issue was marked as Stale because it has been open for 21 days without any activity. If no activity takes place in the coming 7 days it will automatically be close. To prevent this from happening remove the Stale label or comment below.
from bosh-agent.
bosh-admin-bot
commented on June 30, 2024
This issue was marked as Stale because it has been open for 21 days without any activity. If no activity takes place in the coming 7 days it will automatically be close. To prevent this from happening remove the Stale label or comment below.
from bosh-agent.
bgandon
commented on June 30, 2024
@donacarr any news on testing the fixed code?
from bosh-agent.
bosh-admin-bot
commented on June 30, 2024
This issue was marked as Stale because it has been open for 21 days without any activity. If no activity takes place in the coming 7 days it will automatically be close. To prevent this from happening remove the Stale label or comment below.
from bosh-agent.
donacarr
commented on June 30, 2024
Planning to collect log of patched agent when building latest stemcell 1.67 this week.
from bosh-agent.
donacarr
commented on June 30, 2024
Hi @bgandon
in attach the bosh agent log.
Note that the bosh task did not fail but the disk resize did not happen.
Task 30981 | 17:42:10 | Preparing deployment: Preparing deployment (00:00:00)
Task 30981 | 17:42:10 | Preparing deployment: Rendering templates (00:00:00)
Task 30981 | 17:42:10 | Preparing package compilation: Finding packages to compile (00:00:00)
Task 30981 | 17:42:11 | Updating instance colocated: colocated/5e1084dc-46c5-44b3-b3a0-837cc7f9c4ae (0) (canary) (00:02:31)
Task 30981 Started Tue Mar 15 17:42:10 UTC 2022
Task 30981 Finished Tue Mar 15 17:44:42 UTC 2022
Task 30981 Duration 00:02:32
Task 30981 done
df -m
Filesystem 1M-blocks Used Available Use% Mounted on
udev 1932 0 1932 0% /dev
tmpfs 392 5 388 2% /run
/dev/xvda2 24817 1834 21714 8% /
tmpfs 1957 0 1957 0% /dev/shm
tmpfs 5 0 5 0% /run/lock
tmpfs 1957 0 1957 0% /sys/fs/cgroup
/dev/xvda1 242 66 159 30% /boot
/dev/xvdc2 96428 71 91417 1% /var/vcap/data
tmpfs 16 1 16 1% /var/vcap/data/sys/run
/dev/mapper/3600a09803830566b305d51384337654e-part1 20029 45 18945 1% /var/vcap/store
tmpfs 392 0 392 0% /run/user/1001
from bosh-agent.
bgandon
commented on June 30, 2024
From what I can see in the Agent logs, the old disk /dev/mapper/3600a098038305678762b523053344a68 with CID 338029052 is properly migrated to the new disk /dev/mapper/3600a09803830566b305d51384337654e with CID 338029354.
What is strange is the new disk size of 20GB, whereas the BATS test you were pointing in #253 is supposed to migrate a 2GB disk to a 4GB disk.
How could we end up with a 20GB device?
I'm also unsure what was the initial disk size. Could you provide the agent logs when the first disk is created?
from bosh-agent.
bosh-admin-bot
commented on June 30, 2024
This issue was marked as Stale because it has been open for 21 days without any activity. If no activity takes place in the coming 7 days it will automatically be close. To prevent this from happening remove the Stale label or comment below.
from bosh-agent.
donacarr
commented on June 30, 2024
Waiting for the fix to be merged
from bosh-agent.
bosh-admin-bot
commented on June 30, 2024
This issue was marked as Stale because it has been open for 21 days without any activity. If no activity takes place in the coming 7 days it will automatically be close. To prevent this from happening remove the Stale label or comment below.
from bosh-agent.
donacarr
commented on June 30, 2024
Hi @bgandon,
are you going to merge the fix ?
from bosh-agent.
bosh-admin-bot
commented on June 30, 2024
This issue was marked as Stale because it has been open for 21 days without any activity. If no activity takes place in the coming 7 days it will automatically be close. To prevent this from happening remove the Stale label or comment below.
from bosh-agent.
bosh-admin-bot
commented on June 30, 2024
This issue was closed because it has been labeled Stale for 7 days without subsequent activity. Feel free to re-open this issue at any time by commenting below.
from bosh-agent.
bgandon
commented on June 30, 2024
Just a final comment to wrap up that work: the PR #253 (which was merged on Jul 21, 2022 after being was completed) had been validated by IBM on their SoftLayer infrastructure earlier that year (we were in contact through Slack).
The point was to solve a defect on iSCSI device discovery with SoftLayer after the IaaS-native resize feature had been merged in the Bosh-Agent codebase.
The defect has come up because Bosh-Agent was implementing heuristics in that device discovery algorithm that needed to be strengthened (to be honest, they were quite poor in the first place) after the codebase was refactored to introduce IaaS-native disk resize.
from bosh-agent.
Related Issues (20)
- bosh-agent reporting erroneous disk data on bionic HOT 3
- Agent panics from sfdisk output
- bin/test dev script is broken HOT 5
- bin/test-bosh-integration dev script is broken HOT 6
- sfdisk -uM causes partitioning to fail on some linux platforms HOT 4
- Unit test script is broken in main HOT 3
- Agent could be blocked by blobstore access issues HOT 8
- Windows agent is not able to gracefully shutdown job processes HOT 1
- connection flooding from bosh-agents whilst director is unavailable HOT 10
- [Windows] Failing process not reliably reported HOT 1
- (question) Would it be desired to have BTRFS as an alternative filesystem? HOT 2
- Modify the default setup of connection between agent and nats on director HOT 2
- Device path resolution times out for aws and ali HOT 25
- Persistent disk resize fails to handle linux sparse files, resulting in filling up target persistent disk
- Agent fails to boot on Noble Numbat pre-release stemcells
- Document compile command on bosh.io HOT 4
- `bosh-agent compile` generates broken compiled releases HOT 1
- `release.MF` created by `bosh-agent compile` missing dependencies and has invalid fingerprint.
- noble switch from iptables to nftables HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from bosh-agent.