justintimperio / warp-cli Goto Github PK
View Code? Open in Web Editor NEWA CLI tool designed to make interacting with Facebook's Open Source Library "Warp Speed Data Transfer" fast and pain-free.
License: MIT License
A CLI tool designed to make interacting with Facebook's Open Source Library "Warp Speed Data Transfer" fast and pain-free.
License: MIT License
Yo nice tool, but I think auto install isn't quite working yet. This is Ubuntu 18.04.
It seems like /var/app/warp-cli/wdt
should point to /var/app/warp-cli/build/wdt
(setup.py:45) but something else may be wrong. If i try to manually cmake wdt it says folly is not installed. I inspected your setup.py
and I didn't see where it was supposed to make
folly.
teque5 / var app python3 /var/app/warp-cli/core/warp.py --install /var/app/warp-cli
Reading package lists... Done
Building dependency tree
Reading state information... Done
build-essential is already the newest version (12.4ubuntu1).
libboost-system-dev is already the newest version (1.65.1.0ubuntu1).
libdouble-conversion-dev is already the newest version (2.0.1-4ubuntu1).
libboost-all-dev is already the newest version (1.65.1.0ubuntu1).
libgoogle-glog-dev is already the newest version (0.3.5-1).
libgtest-dev is already the newest version (1.8.0-6).
libjemalloc-dev is already the newest version (3.6.0-11).
cmake is already the newest version (3.10.2-1ubuntu2.18.04.1).
libssl-dev is already the newest version (1.1.1-1ubuntu2.1~18.04.4).
openssl is already the newest version (1.1.1-1ubuntu2.1~18.04.4).
0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
Cloning into 'folly'...
remote: Enumerating objects: 193, done.
remote: Counting objects: 100% (193/193), done.
remote: Compressing objects: 100% (155/155), done.
remote: Total 64891 (delta 81), reused 85 (delta 38), pack-reused 64698
Receiving objects: 100% (64891/64891), 26.07 MiB | 1.45 MiB/s, done.
Resolving deltas: 100% (52400/52400), done.
Cloning into 'wdt'...
remote: Enumerating objects: 24, done.
remote: Counting objects: 100% (24/24), done.
remote: Compressing objects: 100% (19/19), done.
remote: Total 4695 (delta 7), reused 16 (delta 5), pack-reused 4671
Receiving objects: 100% (4695/4695), 1.77 MiB | 863.00 KiB/s, done.
Resolving deltas: 100% (3758/3758), done.
CMake Error: The source directory "/var/app/warp-cli/wdt" does not exist.
Specify --help for usage, or press the help button on the CMake GUI.
Install Complete!
Hi,
I have this error on MacOs 14.2
====================================
Installing WDT
====================================
CMake Error at CMakeLists.txt:1:
Parse error. Expected a command name, got unquoted argument with text
"64".
Do you know how I can fix this?
Thanks a lot for all your work
Can you add the following to the install.sh to enable automated install for Rocky 8?
## Rocky
elif [[ $osname == 'rocky' ]]; then
# Install Dependencies
yum -y install epel-release && \
yum -y --enablerepo=powertools install git python38 cmake boost-devel openssl jemalloc glog-devel double-conversion-devel make automake gcc gcc-c++ kernel-devel gtest-devel openssl-devel libeven t-devel
I've been trying to decide if this is ready for production use, and I have some thoughts.
#!/usr/bin/env python3
since pointing to just /usr/bin/python
will resolve weirdly on different machines, and warp-cli isn't python2 compatiblewarp
will hang the whole transfer. Meanwhile rsync
will skip that file then say some files/attrs were not transferred
. scp
will say Permission denied
for that one file.warp --version
. Perhaps put a __version__ = '2.0.0'
somewhere in your script, then you can reference it. It would be best if it printed warp-cli, wdt, and folly version.wdt
is SO verbose. It would be nicer if it were quieter.If I was doing this I would layout warp-cli as a python package like this and in the setup.py
you would add an entry_point
:
setup(
# other stuff
entry_points={
'console_scripts': [
'warp = warp:main',
],
}
)
Then you could simply do a pip install warp-cli
and exit early from the installation if the libraries you needed weren't found. Otherwise it would install warp normally in the user's ~/.local/bin
or wherever.
If you'd like I can create a PR that starts going in this direction, but I didn't want to attempt if you weren't interested.
Hi! Can I use your warp-cli wrapper and WDT to pull data onto a client behind a NAT from a publicly accessible server?
I tried the install script. Thank you so much, it worked on fedora but not in centos 7
here the error:
-- Performing Test FOLLY_HAVE_WEAK_SYMBOLS - Success
CMake Error: The following variables are used in this project, but they are set to NOTFOUND.
Please set them or make sure they are set and tested correctly in the CMake files:
GFLAGS_INCLUDE_DIR
used as include directory in directory /opt/warp-cli/build/wdt
used as include directory in directory /opt/warp-cli/build/wdt
used as include directory in directory /opt/warp-cli/build/wdt
used as include directory in directory /opt/warp-cli/build/wdt
used as include directory in directory /opt/warp-cli/build/wdt
used as include directory in directory /opt/warp-cli/build/wdt
used as include directory in directory /opt/warp-cli/build/wdt
used as include directory in directory /opt/warp-cli/build/wdt
used as include directory in directory /opt/warp-cli/build/wdt
used as include directory in directory /opt/warp-cli/build/wdt
GFLAGS_LIBRARY
linked by target "wdt_min" in directory /opt/warp-cli/build/wdt
-- Configuring incomplete, errors occurred!
See also "/opt/warp-cli/build/wdt/_build/CMakeFiles/CMakeOutput.log".
See also "/opt/warp-cli/build/wdt/_build/CMakeFiles/CMakeError.log".
make: *** No targets specified and no makefile found. Stop.
make: *** No rule to make target `install'. Stop.
====================================
Warp-CLI Version: 3.0.2
sh: /usr/bin/wdt: No such file or directory
FOLLY Version: v2020.01.06.00
how to solve Failed getaddrinfo xiangxiaoyudeMacBook-Pro.local , 58472 : -2 : Name or service not known
Hi,
So the first two commands were successful but running the install script shows the following error.
Any idea what could be wrong?
[user@localhost ~]$ python3 /usr/app/warp-cli/core/warp.py --install
Warp-CLI is Now Setup and Registered in /usr/bin!
Do You Want to Attempt an Automatic WDT Build and Install? (y/n):y
Traceback (most recent call last):
File "/usr/app/warp-cli/core/warp.py", line 148, in
setup_warp(base_dir)
File "/usr/app/warp-cli/core/setup.py", line 55, in setup_warp
build_wdt(base_dir)
File "/usr/app/warp-cli/core/setup.py", line 29, in build_wdt
sys.exit('Automated Package Installs for ' + os_name + ' Are NOT Supported.')
NameError: name 'sys' is not defined
Thank you
installing on wsl2 (ubuntu 22.04) i get this error, any clues?
[ 24%] Building CXX object CMakeFiles/wdt_min.dir/util/WdtSocket.cpp.o
[ 26%] Building CXX object CMakeFiles/wdt_min.dir/ErrorCodes.cpp.o
[ 28%] Building CXX object CMakeFiles/wdt_min.dir/util/DirectorySourceQueue.cpp.o
[ 33%] Building CXX object CMakeFiles/wdt_min.dir/util/EncryptionUtils.cpp.o
[ 33%] Building CXX object CMakeFiles/wdt_min.dir/util/ClientSocket.cpp.o
[ 35%] Building CXX object CMakeFiles/wdt_min.dir/util/FileByteSource.cpp.o
[ 37%] Building CXX object CMakeFiles/wdt_min.dir/Protocol.cpp.o
[ 40%] Building CXX object CMakeFiles/wdt_min.dir/util/FileCreator.cpp.o
[ 42%] Building CXX object CMakeFiles/wdt_min.dir/WdtThread.cpp.o
[ 46%] Building CXX object CMakeFiles/wdt_min.dir/util/ThreadsController.cpp.o
[ 46%] Building CXX object CMakeFiles/wdt_min.dir/ReceiverThread.cpp.o
[ 48%] Building CXX object CMakeFiles/wdt_min.dir/Receiver.cpp.o
[ 51%] Building CXX object CMakeFiles/wdt_min.dir/WdtTransferRequest.cpp.o
[ 53%] Building CXX object CMakeFiles/wdt_min.dir/util/ThreadTransferHistory.cpp.o
[ 55%] Building CXX object CMakeFiles/wdt_min.dir/SenderThread.cpp.o
[ 57%] Building CXX object CMakeFiles/wdt_min.dir/util/ServerSocket.cpp.o
[ 60%] Building CXX object CMakeFiles/wdt_min.dir/Sender.cpp.o
[ 64%] Building CXX object CMakeFiles/wdt_min.dir/Reporting.cpp.o
[ 64%] Building CXX object CMakeFiles/wdt_min.dir/Throttler.cpp.o
[ 66%] Building CXX object CMakeFiles/wdt_min.dir/WdtOptions.cpp.o
[ 68%] Building CXX object CMakeFiles/wdt_min.dir/util/FileWriter.cpp.o
[ 71%] Building CXX object CMakeFiles/wdt_min.dir/util/TransferLogManager.cpp.o
[ 73%] Building CXX object CMakeFiles/wdt_min.dir/util/Stats.cpp.o
[ 75%] Building CXX object CMakeFiles/wdt_min.dir/util/SerializationUtil.cpp.o
In file included from /opt/warp-cli/build/wdt/Sender.cpp:9:
/opt/warp-cli/build/wdt/../wdt/Sender.h:15:10: fatal error: gtest/gtest_prod.h: No such file or directory
15 | #include <gtest/gtest_prod.h>
| ^~~~~~~~~~~~~~~~~~~~
compilation terminated.
In file included from /opt/warp-cli/build/wdt/../wdt/SenderThread.h:11,
from /opt/warp-cli/build/wdt/SenderThread.cpp:9:
/opt/warp-cli/build/wdt/../wdt/Sender.h:15:10: fatal error: gtest/gtest_prod.h: No such file or directory
15 | #include <gtest/gtest_prod.h>
| ^~~~~~~~~~~~~~~~~~~~
compilation terminated.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.