Comments (2)
This one is a little counter-intuitive. When you call the store commands, pigpen doesn't immediately write the output to a file. The reason for this is that you might want to store many things and have them all run at once.
What's returned by the store commands is just a query plan, just like any other operator. You can call pig/dump on the result to execute it. It will return both the results, and write them to a file.
We have considered adding a pig/run to force execution (and be explicit that we were looking for store commands to write), but it's been lower priority since pig/dump does the same thing.
-Matt
On Wednesday, February 24, 2016 at 12:18 AM, Punit Naik wrote:
I have a relation called data the dump of which looks like this:
user=> (pig/dump data) (["2014-12-30" "240465" "18960"] ["2014-12-14" "179355" "14295"] ["2014-12-05" "310706" "4362"] ["2014-12-03" "293209" "14426"] ["2014-11-06" "134263" "10942"] ["2014-09-24" "293763" "18773"] ["2014-09-19" "76412" "6465"] ["2014-08-30" "57813" "18315"] ["2014-08-17" "140325" "15851"] ["2014-08-10" "99408" "10242"] ["2014-07-27" "283646" "7777"] ["2014-07-21" "282190" "6690"] ["2014-07-10" "280308" "6724"] ["2014-04-16" "177294" "5958"] ["2014-04-16" "9630" "9948"] ["2014-04-15" "249966" "7948"] ["2014-03-24" "174913" "7201"] ["2014-03-12" "257354" "4703"] ["2014-01-30" "250252" "45902"] ["2014-01-23" "226169" "7084"] ["2013-12-19" "166220" "5963"] ["2013-12-07" "143208" "6300"] ["2013-11-28" "146795" "11381"] ["2013-08-29" "163403" "17608"] ["2013-08-25" "220460" "5798"] ["2013-07-30" "208614" "2776"] ["2013-07-27" "203026" "5627"] ["2013-07-03" "195602" "19356"])
But when I do a (pig/store-tsv "test.tsv" data), it executes but does not create any file in the working directory. Same goes to pig/store-string.
What am I doing wrong?—
Reply to this email directly or view it on GitHub (#173).
from pigpen.
Thanks a lot @mbossenbroek for clearing my doubts.
from pigpen.
Related Issues (20)
- Strange behavior of count distinct HOT 2
- Add support for distributed cache on the Cascading platform
- Release HOT 2
- Cascading: Optimize co-group with all folds
- Cascading: Add docs & tutorial
- Cascading: Update parquet and avro storage to work with cascading
- CUBE/ROLLUP in PigPen HOT 2
- Libraries/Functions in closures HOT 7
- Should locally executed load functions support compression? HOT 2
- Weird error when used with prismatic plumbing HOT 13
- Use cascading-hadoop2-mr1 by default HOT 10
- allow custom properties to be passed to FlowConnector when creating a flow HOT 2
- Add a pigpen.pig/dump command
- Tutorial error: Pig version 0.12.0-cdh5.4.2,0.14 is right. HOT 5
- Hadoop Versions lists hadoop-client twice in dependencies. HOT 1
- clojure.lang.ExceptionInfo: :auto not supported on headerless data. {} HOT 17
- Incorrect script generation with large number of fields (parquet) HOT 4
- Doc CSS is broken HOT 1
- Is this project being maintained? HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from pigpen.