Comments (6)
Hi, I haven't tried this mode of using datashim but the error failed to start daemon: Unable to get the TempDir under /var/lib/docker: mkdir /var/lib/docker/tmp: transport endpoint is not connected
seems to indicate a network issue. Please check if you have specified endpoint url correctly
from datashim.
I used the PV in simple Nginx pod and its working fine, but when using it as docker root volume , daemon does not start.
from datashim.
Could you post here how you configured datashim/pod ? Also, if you could explain why you are doing it, since so far we have not tried using the PVC in this manner.
You could also try overriding the mountPath
in the CSI-S3 manifests: https://github.com/datashim-io/datashim/blob/8ec79a3aa25334c287dd2c877a2e3765c441f6ca/src/csi-s3/chart/templates/csi-s3.yaml#L140C30-L140C45 and see if that works (re: #160)
from datashim.
I want to use s3 volume as my pod volume to use s3 disk instead of using local disk in my kubernetes environment.
I use this:
apiVersion: com.ie.ibm.hpsys/v1alpha1
kind: Dataset
metadata:
name: docker-cache-s3-dataset
spec:
local:
type: "COS"
accessKeyID: "adf"
secretAccessKey: "adfadsfasdfa"
endpoint: "http://somes3.com"
bucket: "docker-cache"
readonly: "false"
---
kind: ConfigMap
apiVersion: v1
metadata:
name: dind-daemon-test
namespace: adminstuff
data:
config.json: |
{
"auths": {
"docker.example.com": {
"auth": "sfdadfa"
},
"https://index.docker.io/v1/": {
"auth": "adfadsfa="
},
"pvreg.example.com": {
"auth": "adfadfa="
}
},
"proxies":
{
"default":
{
"httpProxy": "http://examples.com",
"httpsProxy": "http://examples.com",
}
}
}
---
kind: Deployment
apiVersion: apps/v1
metadata:
name: dockerbuilder-test
namespace: adminstuff
labels:
app: dockerbuilder
spec:
replicas: 1
selector:
matchLabels:
app: dockerbuilder
template:
metadata:
creationTimestamp: null
labels:
app: dockerbuilder
spec:
volumes:
- name: "docker-dir"
persistentVolumeClaim:
claimName: "docker-cache-s3-dataset"
- name: dind-daemon
configMap:
name: dind-daemon
defaultMode: 420
containers:
- name: dind
image: 'docker:23.0.2-dind'
command:
- dockerd-entrypoint.sh
- '--insecure-registry=pvreg.example.com'
- '--registry-mirror=https://pvreg.example.com'
ports:
- containerPort: 2375
protocol: TCP
env:
- name: http_proxy
value: https://pvreg.example.com
- name: https_proxy
value: https://pvreg.example.com
- name: DOCKER_OPTS
value: >-
-H tcp://0.0.0.0:2375
- name: DOCKER_TLS_CERTDIR
volumeMounts:
- name: "docker-dir"
mountPath: /var/lib/docker
- name: dind-daemon
mountPath: /root/.docker/config.json
subPath: config.json
imagePullPolicy: IfNotPresent
securityContext:
privileged: true
from datashim.
@morteza1131 i would really not recommend changing your docker-volumes to use the volumes provided by csi-s3
. S3 volumes are not POSIX compliant, so there could be serious problems when docker daemon provisions the filesystem for the containers.
from datashim.
I don't want to use it as docker container volume, I only need it to use as docker daemon root volume to store container images build cache.
from datashim.
Related Issues (20)
- Unmounting CSI-S3 volumes results in errors in kubelet HOT 1
- RBAC for CSI NFS attacher does not provide needed access for resource "volumeattachments/status" HOT 1
- Mount error with CSI-S3 volumes in OpenShift
- Pod in Pending state, NFS share not attaching HOT 4
- csi-s3/kubelet error " umount: can't unmount /var/lib/kubelet/pods/.*/volumes/kubernetes.io~csi./*/mount: Invalid argument" HOT 1
- Bug: delete Dataset and containing namespace in quick succession can result in finalizer hang
- Feature request: pass ACCESS_TOKEN to S3 configuration HOT 2
- Deleting dataset before deleting the pod referring to the dataset leads to orphaned DatasetInternal objects HOT 2
- ci: Update testing action to wait for Dataset operator to be ready HOT 2
- If kind is a CRD dlf error on creating pod HOT 4
- Upgrade dependencies of the operator - to latest k8s and controller-runtime HOT 2
- Automount option HOT 1
- Revamp the project website
- Create an issue template for Datashim HOT 1
- Create a user survey for Datashim
- Issue with docker registry HOT 1
- Dataset operator CrashLoopBackOff HOT 4
- PVC keeps having status Pending HOT 5
- Feat: create a README that explains all the fields in a Dataset definition for S3/COS backend
- Feat: create a set of tests for validating the functionality of Dataset with any CSI backend HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from datashim.