tannerjt / agstoshapefile

Convert ArcGIS Server Dynamic Map Service to GeoJSON and Shapefile

AGStoShapefile by TannerGeo

A command line tool for backing up ArcGIS Server REST Services to file.

AGStoShapefile is a node.js script that will convert Esri map services (Geoservices REST API) to GeoJSON and optionally Shapefile formats. This script will export all features and is not limited to max feature limits. AGStoShapefile can be used to cache your map services, store data for offline viewing, or used to build applications using a more simple GeJSON format.

Dependencies

If you wish to download files as Shapefile, you will need to install the following:

1. You will need to install node.js with NPM. This script only runs on node versions 6.x.
2. Install and setup GDAL Windows - Mac/Linux

Instructions

• Create a services.txt to include the services you wish to query

You can install via NPM

    npm install agsout -g

Or, optionally, download and install from local

    npm install . -g

Run the script

    agsout --help
    agsout -s ./services.txt -o ./backupdir -S
    #-s location of services text file
    #-o directory to backup services
    #-S optional shapefile output (requires gdal)

Arguments

This command line script accepts 3 Arguments:

• -s -> Location to services.txt file (see below for example)
• -o -> Location to output directory to put files
• -S -> OPTIONAL Output shapefile, will output geojson as well by default

for services.txt - use format [service_endpoint]|[title]|[throttle in ms]. Take note of the PIPE (|) symbol and new line.

 //example services.txt file
 http://test.service/arcigs/rest/flooding/MapServer/0|Flooding_Layer|0
 http://test.service/arcigs/rest/flooding/MapServer/1|Earthquake_Layer|5000
 http://test.service/arcigs/rest/flooding/MapServer/2|Tornado_Layer|

The throttle is helpful for very large extracts where servers may reject too many requests. The throttle number is in milliseconds.

help

Please contact TannerGeo for questions or assistance.

agstoshapefile's Issues

ReferenceError: primordials is not defined

% npx agsout --help
Need to install the following packages:
  agsout
Ok to proceed? (y) y
npm WARN EBADENGINE Unsupported engine {
npm WARN EBADENGINE   package: '[email protected]',
npm WARN EBADENGINE   required: { node: '>=6.0 <7.0' },
npm WARN EBADENGINE   current: { node: 'v12.16.3', npm: '7.0.10' }
npm WARN EBADENGINE }
npm WARN deprecated [email protected]: this library is no longer supported
npm WARN deprecated [email protected]: This module relies on Node.js's internals and will break at some point. Do not use it, and update to [email protected].
npm WARN deprecated [email protected]: request has been deprecated, see https://github.com/request/request/issues/3142
npm WARN deprecated [email protected]: Please update to minimatch 3.0.2 or higher to avoid a RegExp DoS issue
npm WARN deprecated [email protected]: request-promise has been deprecated because it extends the now deprecated request package, see https://github.com/request/request/issues/3142
fs.js:35
} = primordials;
    ^

ReferenceError: primordials is not defined
    at fs.js:35:5
    at req_ (/Users/lukepighetti/.npm/_npx/399800f66f5e0528/node_modules/natives/index.js:143:24)
    at Object.req [as require] (/Users/lukepighetti/.npm/_npx/399800f66f5e0528/node_modules/natives/index.js:55:10)
    at Object.<anonymous> (/Users/lukepighetti/.npm/_npx/399800f66f5e0528/node_modules/graceful-fs/fs.js:1:37)
    at Module._compile (internal/modules/cjs/loader.js:1133:30)
    at Object.Module._extensions..js (internal/modules/cjs/loader.js:1153:10)
    at Module.load (internal/modules/cjs/loader.js:977:32)
    at Function.Module._load (internal/modules/cjs/loader.js:877:14)
    at Module.require (internal/modules/cjs/loader.js:1019:19)
    at require (internal/modules/cjs/helpers.js:77:18)
    at Object.<anonymous> (/Users/lukepighetti/.npm/_npx/399800f66f5e0528/node_modules/graceful-fs/graceful-fs.js:3:27)
    at Module._compile (internal/modules/cjs/loader.js:1133:30)
    at Object.Module._extensions..js (internal/modules/cjs/loader.js:1153:10)
    at Module.load (internal/modules/cjs/loader.js:977:32)
    at Function.Module._load (internal/modules/cjs/loader.js:877:14)
    at Module.require (internal/modules/cjs/loader.js:1019:19)
    at require (internal/modules/cjs/helpers.js:77:18)
    at Object.<anonymous> (/Users/lukepighetti/.npm/_npx/399800f66f5e0528/node_modules/fstream/lib/reader.js:4:10)
    at Module._compile (internal/modules/cjs/loader.js:1133:30)
    at Object.Module._extensions..js (internal/modules/cjs/loader.js:1153:10)
    at Module.load (internal/modules/cjs/loader.js:977:32)
    at Function.Module._load (internal/modules/cjs/loader.js:877:14)
npm ERR! code 1
npm ERR! path /Users/lukepighetti/development/apps/maine-hunting/mh_tools/assets
npm ERR! command failed
npm ERR! command sh -c agsout --help

npm ERR! A complete log of this run can be found in:
npm ERR!     /Users/lukepighetti/.npm/_logs/2020-12-30T20_42_27_391Z-debug.log

Error after finished extracting chunks. How to merge multiple JSON files to single GeoJSON file?

Dear Mr. Tanner,

Your code is very good to download data from ArcGIS REST server, but I found error after finished extracting chunks, as you can see in picture below:

How would you fix this problem? If I should merge multiple JSON files in folder "partials" by myself, how will I do that?

Regards,
Yusuf Alma

minimatch 1.0.0 deprecated

On 'npm install' :
npm WARN deprecated [email protected]: Please update to minimatch 3.0.2 or higher to avoid a RegExp DoS issue

Partial JSON argument due to GeoJSON big file size

Dear Mr. Tanner,

Yesterday I downloaded very huge file size of GeoJSON (approximately 1,6GB). It need very long time to open with QGIS on my 1st generation Intel Core i5 supported by 6GB RAM only without external GPU. Sometime ago when your program failed to merging multiple JSON to GeoJSON, I found QGIS still can opened its single JSON easily and it is very useful to complete my job.
Based on this experience, I suggest you make another argument for the program to let partial subfolder consist of multiple JSON file be there. If you agree, would you please make re-make them?

Regards,
Yusuf Alma

module ogr2ogr not found, tried npm install but got errors

I tried the suggestion in the closed issue, but get these errors below. Also, when I type ogr2ogr in windows command line it recognizes it. I've also a gist containing the debug log.

https://gist.github.com/kflaw/3110e46bb9dc2ebc5b66331f96cc1505

Error: read ECONNRESET

Hello,

during the downloading chunk process I get error:

internal/streams/legacy.js:57
      throw er; // Unhandled stream error in pipe.
      ^

Error: read ECONNRESET
    at TLSWrap.onStreamRead (internal/stream_base_commons.js:111:27)

This is quite large layer, it happens not regularly (after 50 chunks or 500) but it prevents the download to finish.
I tried to download it with many throttling settings (2000/5000/8000) and the error is still there, do you know any solution?

Code modification for error 502

Hello Joshua,
I am new in the field and I am getting some trouble using your code for a problem, i think, related to the server.
Indeed, I have tried to run AGS to get a layer from this REST service:
" https://map.sitr.regione.sicilia.it/gis/rest/services/catasto/cartografia_catastale/MapServer/4 "
Obtaining the canonical 502 error.

Even in I am not familiar with node and Javascript, I have tried to investigate the cause, that should relies in the index script, where the following query is passed to the server:

var reqQS = {
where: '1=1',
returnIdsOnly: true,
f: 'json'
};

If i pass directly the query in the online interface of the web server, without using AGStoShapefile, it gives me the same 502 error! I think i need to modify some parts of the code to overcome this issue, but don't know where to start.
Can you, or someone else who is familar with that stuff, help me?
Best,
Daniele.

Error Loading table data

When loading a shp file created by AGStoShapefile I get the error:

"Error: Could not load data from data source. If you can correct the problem, press the refresh button to reload data" "A column was specified that does not exist" "A column was specified that does not exist" "Item not found in this collection."

This error message has been consistent for almost every polygon feature class that I've downloaded using this tool, I have been able to work around this issue by converting the .json created by the script.

Type error in terraformer

The program is failing to download all of the json files from a particular server, for me it keeps crashing at the 33rd file.
error_output.txt
services.txt

npm deprecation/notsup warnings

Installing via npm with node v14.09.0/npm 6.14.7 returned several deprecation and not supported warnings:

npm WARN deprecated [email protected]: request-promise has been deprecated because it extends the now deprecated request package, see https://github.com/request/request/issues/3142
npm WARN deprecated [email protected]: this library is no longer supported
npm WARN deprecated [email protected]: Please update to minimatch 3.0.2 or higher to avoid a RegExp DoS issue
npm WARN deprecated [email protected]: This module relies on Node.js's internals and will break at some point. Do not use it, and update to [email protected].
/usr/local/bin/agsout -> /usr/local/lib/node_modules/agsout/index.js
npm WARN notsup Unsupported engine for [email protected]: wanted: {"node":">=6.0 <7.0"} (current: {"node":"14.9.0","npm":"6.14.7"})
npm WARN notsup Not compatible with your version of node/npm: [email protected]

Repeat Issue? TypeError: Cannot read property '0' of undefined

I saw the previous closed issue for [TypeError: Cannot read property '0' of undefined] but am still getting this problem with the latest iteration (Commit 66499ea on 6/20/2016).

The default Services that came with the file worked fine, but when I added my own Service file I got the error TypeError: Cannot read property '0' of undefined.

Also, when I reinstalled after the newest update and I got warnings for depreciated depencies: minimatch and graceful-fs.

Is it possible to have a web interface to enter the service url?

Is it possible to have a web interface to enter the service url and then click download as a shape file button instead of editing the service.txt file? Thanks for your help

GDAL took long.

I got it to create GeoJson, but getting a message ogr2ogr took longer than 15000 to complete.
events.js:160
throw er; // Unhandled 'error' event
^

Error: ogr2ogr took longer than 15000 to complete
at Timeout._onTimeout (C:\AGStoShapefile-master\node_modules\ogr2ogr\index.j
s:192:31)
at ontimeout (timers.js:386:14)
at tryOnTimeout (timers.js:250:5)
at Timer.listOnTimeout (timers.js:214:5)

600 feature limit?

This program is such a break-through!!! Thank you so much for sharing it! I only encountered two issues:

1. it only downloaded the first 600 features. If there is a 600 feature limit, is there a way to just request the 2nd group of 600? The service I tried was http://sigagis.conagua.gob.mx/ArcGIS/rest/services/Acuiferos_2014/MapServer/0 if you want to test it. Thanks in advance for any tips on this.
2. it didn't apply the name I assigned after the | in services.txt, but no big deal, I just renamed the output.

Getting the following error: throw er; // Unhandled 'error' event

Hi, I am getting the following error:

info: Number of features for service: 2848
info: Getting chunks of 100 features...
info: query -> 0 out of 2848
info: query -> 100 out of 2848
info: query -> 200 out of 2848
info: query -> 300 out of 2848
info: query -> 400 out of 2848
info: query -> 500 out of 2848
info: query -> 600 out of 2848
info: query -> 700 out of 2848
info: query -> 800 out of 2848
info: query -> 900 out of 2848
info: query -> 1000 out of 2848
info: query -> 1100 out of 2848
info: query -> 1200 out of 2848
info: query -> 1300 out of 2848
info: query -> 1400 out of 2848
info: query -> 1500 out of 2848
info: query -> 1600 out of 2848
info: query -> 1700 out of 2848
info: query -> 1800 out of 2848
info: query -> 1900 out of 2848
info: query -> 2000 out of 2848
info: query -> 2100 out of 2848
info: query -> 2200 out of 2848
info: query -> 2300 out of 2848
info: query -> 2400 out of 2848
info: query -> 2500 out of 2848
info: query -> 2600 out of 2848
info: query -> 2700 out of 2848
info: query -> 2800 out of 2848
info: Number of features for service: 950
info: Getting chunks of 100 features...
info: query -> 0 out of 950
info: query -> 100 out of 950
info: query -> 200 out of 950
info: query -> 300 out of 950
info: query -> 400 out of 950
info: query -> 500 out of 950
info: query -> 600 out of 950
info: query -> 700 out of 950
info: query -> 800 out of 950
info: query -> 900 out of 950
info: Number of features for service: 144
info: Getting chunks of 100 features...
info: query -> 0 out of 144
info: query -> 100 out of 144
info: all requests settled
info: creating Point Features json
info: Creating Esri JSON
info: Creating GeoJSON
info: Creating Shapefile

events.js:72
throw er; // Unhandled 'error' event
^
Error: ENOENT, open './output/Point Features.json'

Any help would be greatly appreciated!

Janosch

TypeError when running 'node AGStoSHP.js'

C:\mlc\AGStoShapefile-master>node AGStoSHP.js
util.js:965
throw new TypeError('The super constructor to "inherits" must not ' +
^

TypeError: The super constructor to "inherits" must not be null or undefined
at Object.exports.inherits (util.js:965:11)
at Object. (C:\mlc\AGStoShapefile-master\node_modules\objectstream\lib\objectstream.js:43:6)
at Module._compile (module.js:573:32)
at Object.Module._extensions..js (module.js:582:10)
at Module.load (module.js:490:32)
at tryModuleLoad (module.js:449:12)
at Function.Module._load (module.js:441:3)
at Module.require (module.js:500:17)
at require (internal/module.js:20:19)
at Object. (C:\mlc\AGStoShapefile-master\AGStoSHP.js:13:20)

services.txt:
http://services.arcgis.com/ptvDyBs1KkcwzQNJ/arcgis/rest/services/Leon_Buildings/FeatureServer/0|Leon_Buildings
http://services.arcgis.com/ptvDyBs1KkcwzQNJ/arcgis/rest/services/Road_Edge_2012/FeatureServer/0|Road_Edge_2012

error code 500?

info: code=500, message=Error performing query operation, details=[]

/home/fsadmin/AGStoShapefile-master/AGStoSHP.js:63
throw err;
^
[object Object]

services.txt:
https://kataster.skgeodesy.sk/eskn/rest/services/VRM/parcels_e_view/MapServer/1|test

Crash when only one feature

(node:13548) DeprecationWarning: process.EventEmitter is deprecated. Use require
('events') instead.
info: Number of features for service: 1
info: Getting chunks of 100 features...
info: query -> 0 out of 1
C:\AGStoShapefile-master\AGStoSHP.js:71
objectIds.sort();
^

TypeError: Cannot read property 'sort' of null
at requestService (C:\AGStoShapefile-master\AGStoSHP.js:71:11)
at Request._callback (C:\AGStoShapefile-master\AGStoSHP.js:64:4)
at Request.self.callback (C:\AGStoShapefile-master\node_modules\request\requ
est.js:188:22)
at emitTwo (events.js:106:13)
at Request.emit (events.js:191:7)
at Request. (C:\AGStoShapefile-master\node_modules\request\reques
t.js:1171:10)
at emitOne (events.js:96:13)
at Request.emit (events.js:188:7)
at IncomingMessage. (C:\AGStoShapefile-master\node_modules\reques
t\request.js:1091:12)
at IncomingMessage.g (events.js:292:16)

C:\AGStoShapefile-master>node AGStoSHP.js services.txt W:/NZPM_Shapefiles

Too many open files.... Is it possible to increase the chunk size from 100 to say... 1000?

Number of features for service parcels: 1562692
Getting chunks of 100 features, will make 15627 total requests
events.js:183
throw er; // Unhandled 'error' event

Error: EMFILE: too many open files, open 'c:\Users{user}\Desktop\AGStoShapefile\shapefiles\parcels\partials\8190.json'

TypeError: Cannot read property 'sort' of undefined.

C:\Users\Vinura\Documents\OneDrive\Tower Placement Problem QGIS Solution\Data\Geographical Daa\Elevation>agsout -s ./services.txt -o ./
TypeError: Cannot read property 'sort' of undefined
at requestService (C:\Users\Vinura\AppData\Roaming\npm\node_modules\agsout\index.js:79:11)
at rp.then (C:\Users\Vinura\AppData\Roaming\npm\node_modules\agsout\index.js:70:4)
at tryCatcher (C:\Users\Vinura\AppData\Roaming\npm\node_modules\agsout\node_modules\bluebird\js\release\util.js:16:23)
at Promise._settlePromiseFromHandler (C:\Users\Vinura\AppData\Roaming\npm\node_modules\agsout\node_modules\bluebird\js\release\promise.js:517:31)
at Promise._settlePromise (C:\Users\Vinura\AppData\Roaming\npm\node_modules\agsout\node_modules\bluebird\js\release\promise.js:574:18)
at Promise._settlePromise0 (C:\Users\Vinura\AppData\Roaming\npm\node_modules\agsout\node_modules\bluebird\js\release\promise.js:619:10)
at Promise._settlePromises (C:\Users\Vinura\AppData\Roaming\npm\node_modules\agsout\node_modules\bluebird\js\release\promise.js:699:18)
at _drainQueueStep (C:\Users\Vinura\AppData\Roaming\npm\node_modules\agsout\node_modules\bluebird\js\release\async.js:138:12)
at _drainQueue (C:\Users\Vinura\AppData\Roaming\npm\node_modules\agsout\node_modules\bluebird\js\release\async.js:131:9)
at Async._drainQueues (C:\Users\Vinura\AppData\Roaming\npm\node_modules\agsout\node_modules\bluebird\js\release\async.js:147:5)
at Immediate.Async.drainQueues (C:\Users\Vinura\AppData\Roaming\npm\node_modules\agsout\node_modules\bluebird\js\release\async.js:17:14)
at runCallback (timers.js:672:20)
at tryOnImmediate (timers.js:645:5)
at processImmediate [as _immediateCallback] (timers.js:617:5)

Fields with value of 0 interpreted as empty

Any field with a value of 0 ends up as an empty field.

Cannot read property 'spatialReference' of undefined

The script has gone through 538 requests before it bombs on this. It it coming upon a record that doesn't have a spatialreference? Is there a way for it to skip over the record or is it something else? Thanks.

The url is http://maps.dekalbcountyga.gov/arcgis/rest/services/TaxParcels/MapServer/20|Parcels|1000

TypeError: Cannot read property 'spatialReference' of undefined
at Object.parse (C:\Users\XXXXX\AppData\Roaming\npm\node_modules\agsout\node_modules\terraformer-arcgis-parser\terraformer-arcgis-parser.js:262:16)
at convert (C:\Users\XXXXX\AppData\Roaming\npm\node_modules\agsout\index.js:162:33)
at Parser.parser.onValue (C:\Users\XXXXX\AppData\Roaming\npm\node_modules\agsout\node_modules\JSONStream\index.js:107:32)
at Parser.proto.emit (C:\Users\XXXXX\AppData\Roaming\npm\node_modules\agsout\node_modules\jsonparse\jsonparse.js:337:8)
at Parser.proto.pop (C:\Users\XXXXX\AppData\Roaming\npm\node_modules\agsout\node_modules\jsonparse\jsonparse.js:332:8)
at Parser.proto.onToken (C:\Users\XXXXX\AppData\Roaming\npm\node_modules\agsout\node_modules\jsonparse\jsonparse.js:402:12)
at Parser.parser.onToken (C:\Users\XXXXX\AppData\Roaming\npm\node_modules\agsout\node_modules\JSONStream\index.js:126:12)
at Parser.proto.write (C:\Users\XXXXX\AppData\Roaming\npm\node_modules\agsout\node_modules\jsonparse\jsonparse.js:135:34)
at Stream. (C:\Users\XXXXX\AppData\Roaming\npm\node_modules\agsout\node_modules\JSONStream\index.js:21:12)
at Stream.stream.write (C:\Users\XXXXX\AppData\Roaming\npm\node_modules\agsout\node_modules\through\index.js:26:11)
at Request.ondata (internal/streams/legacy.js:15:31)
at Request.emit (events.js:182:13)
at IncomingMessage. (C:\Users\XXXXX\AppData\Roaming\npm\node_modules\agsout\node_modules\request\request.js:1080:12)
at IncomingMessage.emit (events.js:182:13)
at IncomingMessage.Readable.read (_stream_readable.js:486:10)
at flow (stream_readable.js:922:34)
at resume (_stream_readable.js:904:3)
at process._tickCallback (internal/process/next_tick.js:63:19)

More Console Info?

Not so much an issue, as a suggestion. I haven't taken much time to dig into the source, so I'm not sure where these console.log()'s would go, but it would be great to have a little more info at the terminal prompt to know exactly what's going on with the service/script. Especially with rest services that have a max county of 1000, and have 100's of thousands (or even millions) of results. I let the service run for 9 hours in one go with no feedback. I finally quit it, but it would be great to know if it was actually doing something, or at what point the hang was occurring. Thank you for any consideration, or assistance you can offer.

DeprecationWarning

I am new to Node.js, and have very limited knowledge of coding. That being said, I am attempting to use AGStoSHP to create a shapefile from a WMS service layer for use in ArcMap. I am under the impression that this tool will allow me to accomplish this, but please correct me if I am wrong. Let me briefly explain the process that I have gone through.

---

• I first installed Python 3.6.1 amd64 on my 64-bit windows machine. Since then, I have realized that Python 2.7 is already installed, which is the version that Arc is using. I have not yet tried installing GDAL with Python 2.7.

• I then installed GDAL 2.1.3 amd64, following the instructions here: ( https://sandbox.idre.ucla.edu/sandbox/tutorials/installing-gdal-for-windows ).

• I then installed Node.js 6.10.2 (x64) with npm. I have also tried using version 7.9.0, which didn't work either.

• After downloading the 'AGStoShapefile-master' and saving it to my Documents folder, I edited the 'services.txt', leaving only my service ( http://sig.se.gob.ar/cgi-bin/mapserv6|planosbase_puntos_caracteristicos ).

• I then opened the Node.js command prompt, navigated to the AGStoShapefile-master folder, and entered the following :

node agstoshp.js services.txt ./output/

• Here is the output that was returned:

(node:9444) DeprecationWarning: process.EventEmitter is deprecated. Use require('events') instead.
C:\Users\kzx318\Documents\AGStoShapefile-master\AGStoShapefile-master\agstoshp.js:71
objectIds.sort();
^

TypeError: Cannot read property 'sort' of undefined
at requestService (C:\Users\kzx318\Documents\AGStoShapefile-master\AGStoShapefile-master\agstoshp.js:71:11)
at Request._callback (C:\Users\kzx318\Documents\AGStoShapefile-master\AGStoShapefile-master\agstoshp.js:64:4)
at Request.self.callback (C:\Users\kzx318\Documents\AGStoShapefile-master\AGStoShapefile-master\node_modules\request\request.js:188:22)
at emitTwo (events.js:106:13)
at Request.emit (events.js:191:7)
at Request. (C:\Users\kzx318\Documents\AGStoShapefile-master\AGStoShapefile-master\node_modules\request\request.js:1171:10)
at emitOne (events.js:96:13)
at Request.emit (events.js:188:7)
at IncomingMessage. (C:\Users\kzx318\Documents\AGStoShapefile-master\AGStoShapefile-master\node_modules\request\request.js:1091:12)
at IncomingMessage.g (events.js:291:16)

---

Like I said before, my knowledge is limited, but I can follow if told where to go, what to look for and what to change. Any help that anyone could provide would be extremely appreciated.

Feature Missing Geometry and is Omitted

http://services.kars.ku.edu/arcgis/rest/services/KansasStreamsOrder/MapServer/0

Trying to grab this service. Entire dataset is referenced as "Feature Missing Geometry and is Omitted" and the resulting output is empty.

.prj file missing in output

I have been using AGStoShapefile successfully in downloading all layers from
http://gis.dallascityhall.com/wwwgis/rest/services/Sdc_public/Zoning/MapServer

However, none of the output .zip files contain .prj files (only .shp, .shx, .dbf) , although the ESPG is specified by the map service in all layers as 2276.

Is there a way to resolve this?

No shapefile output (bigdata branch)

My cmd output is showing that a shapefile was created, but I'm not seeing it in my output folder. There are only the json and geojson files.

Fails without error message

Hi,

Running

Ubuntu 14.04.3 LTS
$node -v
v0.10.25

I'm trying to download this and that. I'm copying and pasting the link to the REST endpoint and have a services.txt which looks like.

http://maps.cityofboston.gov/ArcGIS/rest/services/BaseServices/Bike_network/MapServer/2?f=json&pretty=true|30year
http://maps.cityofboston.gov/ArcGIS/rest/services/BaseServices/Bike_network/MapServer/1?f=json&pretty=true|5year

When I run node AGStoSHP.js I get

creating 5year geojson
creating 30year geojson

but the contents of output are merely placeholder.txt

Support win-1251 Cyryllic

Hi,

What if layers name on Cryrllic win-1251 and has space.

Layer names looks like this "Населенные Пункты"??
I tried to do node cmd and have next error:

(node:4020) DeprecationWarning: process.EventEmitter is deprecated. Use require(
'events') instead.
info: code=400, message=Invalid or missing input parameters., details=[]

C:\Users\MOC\Documents\AGStoShapefile-master\AGStoShapefile-master\AGStoSHP.js:6
2
throw err;
^
[object Object]

the link in txt file is x.x.x.x/arcgis/rest/services/Kazakhstan_WM/MapServer/23|Астана

With latic symbols it works
Thank you

module ogr2ogr not found

Hi
i have an issue. why did appear this message when i tried to run the module:
" error: cannot find the module 'ogr2ogr'

regards,

Read Error

Hi -
I'm trying to pull data from a large dataset (using the bigdata branch).
Here's the error Im getting:

info: TypeError: Cannot read property 'attributes' of undefined
at toGeoJSON (C:\Users\jfruhwirth\Downloads\AGSBigData\node_modules\esri2geo\esri2geo.js:18:24)
at C:\Users\jfruhwirth\Downloads\AGSBigData\agstoshp.js:186:17
at _fulfilled (C:\Users\jfruhwirth\Downloads\AGSBigData\node_modules\q\q.js:834:54)
at self.promiseDispatch.done (C:\Users\jfruhwirth\Downloads\AGSBigData\node_modules\q\q.js:863:30)
at Promise.promise.promiseDispatch (C:\Users\jfruhwirth\Downloads\AGSBigData\node_modules\q\q.js:796:13)
at C:\Users\jfruhwirth\Downloads\AGSBigData\node_modules\q\q.js:604:44
at runSingle (C:\Users\jfruhwirth\Downloads\AGSBigData\node_modules\q\q.js:137:13)
at flush (C:\Users\jfruhwirth\Downloads\AGSBigData\node_modules\q\q.js:125:13)
at _combinedTickCallback (internal/process/next_tick.js:67:7)
at process._tickCallback (internal/process/next_tick.js:98:9)

Here's the REST service I'm trying to pull from: hazards.fema.gov/gis/nfhl/rest/services/public/NFHL/MapServer/28

Any help would be appreciated.

Thanks

Cannot read property '0' of undefined

node 6.11.3

info:  TypeError: Cannot read property '0' of undefined
    at /home/ubuntu/data/acropolis/arcdump/AGStoShapefile/AGStoSHP.js:123:72
    at _fulfilled (/home/ubuntu/data/acropolis/arcdump/AGStoShapefile/node_modules/q/q.js:854:54)
    at self.promiseDispatch.done (/home/ubuntu/data/acropolis/arcdump/AGStoShapefile/node_modules/q/q.js:883:30)
    at Promise.promise.promiseDispatch (/home/ubuntu/data/acropolis/arcdump/AGStoShapefile/node_modules/q/q.js:816:13)
    at /home/ubuntu/data/acropolis/arcdump/AGStoShapefile/node_modules/q/q.js:624:44
    at runSingle (/home/ubuntu/data/acropolis/arcdump/AGStoShapefile/node_modules/q/q.js:137:13)
    at flush (/home/ubuntu/data/acropolis/arcdump/AGStoShapefile/node_modules/q/q.js:125:13)
    at _combinedTickCallback (internal/process/next_tick.js:73:7)
    at process._tickCallback (internal/process/next_tick.js:104:9)

Error: Invalid URI "/query"

I am getting the error in image below using the attached services file. Any ideas as to the cause?

services.txt

ENOENT error

By default, the script takes an input txt file with services and outputs .shp, .json files. This services.txt is located in the AGStoShapefile directory, and in the terminal the script runs perfectly until line 154, at which point the following error appears:

node AGStoSHP.js
info: Number of features for service:  225
info: Getting chunks of 100 features...
info: query -> 0 out of 225
info: query -> 100 out of 225
info: query -> 200 out of 225
info: Number of features for service:  8258
info: Getting chunks of 100 features...
info: query -> 0 out of 8258
info: query -> 100 out of 8258
info: query -> 200 out of 8258
info: query -> 300 out of 8258
info: query -> 400 out of 8258
info: query -> 500 out of 8258
info: query -> 600 out of 8258
info: query -> 700 out of 8258
info: query -> 800 out of 8258
info: query -> 900 out of 8258
it continues...

info: query -> 7100 out of 8258
info: query -> 7200 out of 8258
info: query -> 7300 out of 8258
info: query -> 7400 out of 8258
info: query -> 7500 out of 8258
info: query -> 7600 out of 8258
info: query -> 7700 out of 8258
info: query -> 7800 out of 8258
info: query -> 7900 out of 8258
info: query -> 8000 out of 8258
info: query -> 8100 out of 8258
info: query -> 8200 out of 8258
info: all requests settled
info: creating WildFire json
info: Creating Esri JSON
info: Creating GeoJSON
info: Creating Shapefile
events.js:154
      throw er; // Unhandled 'error' event
      ^

Error: ENOENT: no such file or directory, open './output/WildFire.json'
    at Error (native)

Any idea how to resolve this?

what/where should I take a look for this error? service.txt has valid url

http://map.trueautomation.com/ArcGIS/rest/services/Brazos/MapServer/10|subdiv

C:>node AGStoSHP.js
creating BZSchool json
creating BZSchool geojson
[Error: Error: spawn ogr2ogr ENOENT]
[Error: Error: spawn ogr2ogr ENOENT]
creating BZSchool shapefile
events.js:141
throw er; // Unhandled 'error' event
^

Error: Error: spawn ogr2ogr ENOENT
at ChildProcess. (C:\node_modules\ogr2ogr\index.js:187:18)
at emitTwo (events.js:87:13)
at ChildProcess.emit (events.js:172:7)
at maybeClose (internal/child_process.js:818:16)
at Socket. (internal/child_process.js:319:11)
at emitOne (events.js:77:13)
at Socket.emit (events.js:169:7)
at Pipe._onclose (net.js:469:12)

error running node AGS

[root@vps96840 ags]# node AGStoSHP.js
util.js:962
throw new TypeError('The super constructor to "inherits" must not ' +
^

TypeError: The super constructor to "inherits" must not be null or undefined
at Object.exports.inherits (util.js:962:11)
at Object. (/home/travis/ags/node_modules/objectstream/lib/objectstream.js:43:6)
at Module._compile (module.js:571:32)
at Object.Module._extensions..js (module.js:580:10)
at Module.load (module.js:488:32)
at tryModuleLoad (module.js:447:12)
at Function.Module._load (module.js:439:3)
at Module.require (module.js:498:17)
at require (internal/module.js:20:19)
at Object. (/home/travis/ags/AGStoSHP.js:13:20)

[TypeError: Cannot read property '0' of undefined]

When I run the tool. see this error. Wonder what the reason is. Thanks

$ node AGStoSHP.js
[TypeError: Cannot read property '0' of undefined]

info: TypeError: Cannot read property '0' of undefined

Hi I have problems running this tool on OSX. I'm using this service file

http://www.geoportal.cl/arcgis/rest/services/MinisteriodeMineria/chile_mmin_sernageomin_faenas_mineras/MapServer/0|Faenas_Minera

Can you help me please?

robsalasco@galatos:~/AGStoShapefile$ node AGStoSHP.js
(node:54739) DeprecationWarning: process.EventEmitter is deprecated. Use require('events') instead.
info: Number of features for service:  1869
info: Getting chunks of 100 features...
info: query -> 0 out of 1869
info: query -> 100 out of 1869
info: query -> 200 out of 1869
info: query -> 300 out of 1869
info: query -> 400 out of 1869
info: query -> 500 out of 1869
info: query -> 600 out of 1869
info: query -> 700 out of 1869
info: query -> 800 out of 1869
info: query -> 900 out of 1869
info: query -> 1000 out of 1869
info: query -> 1100 out of 1869
info: query -> 1200 out of 1869
info: query -> 1300 out of 1869
info: query -> 1400 out of 1869
info: query -> 1500 out of 1869
info: query -> 1600 out of 1869
info: query -> 1700 out of 1869
info: query -> 1800 out of 1869
info: all requests settled
info:  TypeError: Cannot read property '0' of undefined
    at /Users/robsalasco/AGStoShapefile/AGStoSHP.js:123:72
    at _fulfilled (/Users/robsalasco/AGStoShapefile/node_modules/q/q.js:834:54)
    at self.promiseDispatch.done (/Users/robsalasco/AGStoShapefile/node_modules/q/q.js:863:30)
    at Promise.promise.promiseDispatch (/Users/robsalasco/AGStoShapefile/node_modules/q/q.js:796:13)
    at /Users/robsalasco/AGStoShapefile/node_modules/q/q.js:604:44
    at runSingle (/Users/robsalasco/AGStoShapefile/node_modules/q/q.js:137:13)
    at flush (/Users/robsalasco/AGStoShapefile/node_modules/q/q.js:125:13)
    at _combinedTickCallback (internal/process/next_tick.js:67:7)
    at process._tickCallback (internal/process/next_tick.js:98:9)```

esriGeometryPolyline Support

Unclear to me if user error or support for esriGeometryPolyline.

Layer displays correctly in ArcGIS.com Map, though after exporting, when viewing the shp file in Google Earth, the multilines appear to be polygons (and so the end points connect) instead of line segments.

Below are the first lines from the same row in the geojson and json outputs:
.geojson
{"type":"Feature","properties":{"OBJECTID":1071"},"geometry":{"type":"LineString","coordinates":[[-119.647301879969,36.3357155706448],[-119.647158201001,36.3357135082167],[-119.647464919848,36.3366388079793],[-119.64692081726,36.3366362560468],[-119.646545690005,36.336634499629],[-119.645945393976,36.3366411375299],[-119.647977465194,36.3347529144588],[-119.647972063749,36.3359228368254],[-119.648050601153,36.3359234973508],[-119.647961203623,36.3361471556729],

.json:
{"attributes":{"OBJECTID":1071"},"geometry":{"paths":
[[[-119.647301879969,36.3357155706448],[-119.647158201001,36.3357135082167]],[[-119.647464919848,36.3366388079793],[-119.64692081726,36.3366362560468],[-119.646545690005,36.336634499629],[-119.645945393976,36.3366411375299]],[[-119.647977465194,36.3347529144588],[-119.647972063749,36.3359228368254],[-119.648050601153,36.3359234973508]],[[-119.647961203623,36.3361471556729],

Any direction would be greatly appreciated.

I am getting TypeError: Cannot read property 'sort' of null

Hello could you help me?

I am getting the following error when I try to run AGStoShapefile:

TypeError: Cannot read property 'sort' of null
at requestService (C:\Users\Administrator\AppData\Roaming\npm\node_modules\agsout\index.js:79:11)
at rp.then (C:\Users\Administrator\AppData\Roaming\npm\node_modules\agsout\index.js:70:4)
at tryCatcher (C:\Users\Administrator\AppData\Roaming\npm\node_modules\agsout\node_modules\bluebird\js\release\util.js:16:23)
at Promise._settlePromiseFromHandler (C:\Users\Administrator\AppData\Roaming\npm\node_modules\agsout\node_modules\bluebird\js\release\promise.js:512:31)
at Promise._settlePromise (C:\Users\Administrator\AppData\Roaming\npm\node_modules\agsout\node_modules\bluebird\js\release\promise.js:569:18)
at Promise._settlePromise0 (C:\Users\Administrator\AppData\Roaming\npm\node_modules\agsout\node_modules\bluebird\js\release\promise.js:614:10)
at Promise._settlePromises (C:\Users\Administrator\AppData\Roaming\npm\node_modules\agsout\node_modules\bluebird\js\release\promise.js:694:18)
at _drainQueueStep (C:\Users\Administrator\AppData\Roaming\npm\node_modules\agsout\node_modules\bluebird\js\release\async.js:138:12)
at _drainQueue (C:\Users\Administrator\AppData\Roaming\npm\node_modules\agsout\node_modules\bluebird\js\release\async.js:131:9)
at Async._drainQueues (C:\Users\Administrator\AppData\Roaming\npm\node_modules\agsout\node_modules\bluebird\js\release\async.js:147:5)
at Immediate.Async.drainQueues (C:\Users\Administrator\AppData\Roaming\npm\node_modules\agsout\node_modules\bluebird\js\release\async.js:17:14)
at runCallback (timers.js:672:20)
at tryOnImmediate (timers.js:645:5)
at processImmediate [as _immediateCallback] (timers.js:617:5)

TypeError: Cannot read property 'push' of undefined

info: TypeError: Cannot read property 'push' of undefined
at decodePolygon (C:\AGStoShapefileBD\node_modules\esri2geo\esri2geo.js:78:17)
at poly (C:\AGStoShapefileBD\node_modules\esri2geo\esri2geo.js:64:11)
at toGeoJSON (C:\AGStoShapefileBD\node_modules\esri2geo\esri2geo.js:31:19)
at C:\AGStoShapefileBD\AGStoSHP.js:186:17
at _fulfilled (C:\AGStoShapefileBD\node_modules\q\q.js:854:54)
at self.promiseDispatch.done (C:\AGStoShapefileBD\node_modules\q\q.js:883:30)
at Promise.promise.promiseDispatch (C:\AGStoShapefileBD\node_modules\q\q.js:816:13)
at C:\AGStoShapefileBD\node_modules\q\q.js:624:44
at runSingle (C:\AGStoShapefileBD\node_modules\q\q.js:137:13)
at flush (C:\AGStoShapefileBD\node_modules\q\q.js:125:13)

services.txt:

http://gis.wyo.gov/arcgis/rest/services/ets/Parcels2017/MapServer/0|Parcel Boundary

TypeError: Cannot read property 'attributes' of undefined

Appears to specifically be an issue with esri2geo, but reporting here as unsure of exact cause.

info: all requests settled
info: creating Coastal.Coastline_line json
info: Creating Esri JSON
info: Creating GeoJSON
info:  TypeError: Cannot read property 'attributes' of undefined
    at toGeoJSON (/projects/AGStoShapefile/node_modules/esri2geo/esri2geo.js:18:24)
    at /projects/AGStoShapefile/AGStoSHP.js:140:3
    at _fulfilled (/projects/AGStoShapefile/node_modules/q/q.js:854:54)
    at self.promiseDispatch.done (/projects/AGStoShapefile/node_modules/q/q.js:883:30)
    at Promise.promise.promiseDispatch (/projects/AGStoShapefile/node_modules/q/q.js:816:13)
    at /projects/AGStoShapefile/node_modules/q/q.js:624:44
    at runSingle (/projects/AGStoShapefile/node_modules/q/q.js:137:13)
    at flush (/projects/AGStoShapefile/node_modules/q/q.js:125:13)
    at _combinedTickCallback (internal/process/next_tick.js:73:7)
    at process._tickCallback (internal/process/next_tick.js:104:9)

Was able to finish the job successfully after editing node_modules/esri2geo/esri2geo.js to skip processing in the toGeoJSON loop where the feature from the array was falsy.

services.txt:

https://encdirect.noaa.gov/arcgis/rest/services/encdirect/enc_coastal/MapServer/70|Coastal.Coastline_line

Type error

After changing the services in the service.txt file to:

http://gis.dallascityhall.com/wwwgis/rest/services/Sdc_public/Zoning/MapServer/0

I encounter the following error:

/Users/alexander/Downloads/AGStoShapefile/AGStoSHP.js:64
            requestService(service[0].trim(), service[1].trim(), body.objectIds);
                                                        ^

TypeError: Cannot read property 'trim' of undefined
    at Request._callback (/Users/alexander/Downloads/AGStoShapefile/AGStoSHP.js:64:48)
    at Request.self.callback (/Users/alexander/Downloads/AGStoShapefile/node_modules/request/request.js:186:22)
    at emitTwo (events.js:100:13)
    at Request.emit (events.js:185:7)
    at Request.<anonymous> (/Users/alexander/Downloads/AGStoShapefile/node_modules/request/request.js:1060:10)
    at emitOne (events.js:90:13)
    at Request.emit (events.js:182:7)
    at IncomingMessage.<anonymous> (/Users/alexander/Downloads/AGStoShapefile/node_modules/request/request.js:980:12)
    at IncomingMessage.g (events.js:273:16)
    at emitNone (events.js:85:20)

Does it having something to do with having no spaces in the url?

Print better failure message

When |Flooding_Layer|0 is missing, the program is just failing. Instead it should detect such a mistake!

TypeError: Cannot read property 'trim' of undefined
    at rp.then (/usr/lib/node_modules/agsout/index.js:70:49)
    at tryCatcher (/usr/lib/node_modules/agsout/node_modules/bluebird/js/release/util.js:16:23)
    at Promise._settlePromiseFromHandler (/usr/lib/node_modules/agsout/node_modules/bluebird/js/release/promise.js:512:31)
    at Promise._settlePromise (/usr/lib/node_modules/agsout/node_modules/bluebird/js/release/promise.js:569:18)
    at Promise._settlePromise0 (/usr/lib/node_modules/agsout/node_modules/bluebird/js/release/promise.js:614:10)
    at Promise._settlePromises (/usr/lib/node_modules/agsout/node_modules/bluebird/js/release/promise.js:693:18)
    at Async._drainQueue (/usr/lib/node_modules/agsout/node_modules/bluebird/js/release/async.js:133:16)
    at Async._drainQueues (/usr/lib/node_modules/agsout/node_modules/bluebird/js/release/async.js:143:10)
    at Immediate.Async.drainQueues (/usr/lib/node_modules/agsout/node_modules/bluebird/js/release/async.js:17:14)
    at runCallback (timers.js:794:20)
    at tryOnImmediate (timers.js:752:5)
    at processImmediate [as _immediateCallback] (timers.js:729:5)

Shapefile issue

I'm having issues getting AGStoShapefile to work on the following link...

http://gis.publicaccessnow.com/arcgis/rest/services/ScottKs/ScottKsDynamic/MapServer

When the script is ran it creates the following in the "output" folder...

Below is what the script looks like when it runs

C:\Users\(BLANK)\Desktop\AGStoShapefile-bigdata>node agstoshp.js (node:5624) DeprecationWarning: process.EventEmitter is deprecated. Use require('events') instead. info: Number of features for service: 4293 info: Getting chunks of 20 features... info: query -> 0 out of 4293 info: query -> 20 out of 4293 info: query -> 40 out of 4293 info: query -> 60 out of 4293 info: query -> 80 out of 4293 info: query -> 100 out of 4293 info: query -> 120 out of 4293 info: query -> 140 out of 4293 info: query -> 160 out of 4293 info: query -> 180 out of 4293 info: query -> 200 out of 4293 info: query -> 220 out of 4293 info: query -> 240 out of 4293 info: query -> 260 out of 4293 info: query -> 280 out of 4293 info: query -> 300 out of 4293 info: query -> 320 out of 4293 info: query -> 340 out of 4293 info: query -> 360 out of 4293 info: query -> 380 out of 4293 info: query -> 400 out of 4293 info: query -> 420 out of 4293 info: query -> 440 out of 4293 info: query -> 460 out of 4293 info: query -> 480 out of 4293 info: query -> 500 out of 4293 info: query -> 520 out of 4293 info: query -> 540 out of 4293 info: query -> 560 out of 4293 info: query -> 580 out of 4293 info: query -> 600 out of 4293 info: query -> 620 out of 4293 info: query -> 640 out of 4293 info: query -> 660 out of 4293 info: query -> 680 out of 4293 info: query -> 700 out of 4293 info: query -> 720 out of 4293 info: query -> 740 out of 4293 info: query -> 760 out of 4293 info: query -> 780 out of 4293 info: query -> 800 out of 4293 info: query -> 820 out of 4293 info: query -> 840 out of 4293 info: query -> 860 out of 4293 info: query -> 880 out of 4293 info: query -> 900 out of 4293 info: query -> 920 out of 4293 info: query -> 940 out of 4293 info: query -> 960 out of 4293 info: query -> 980 out of 4293 info: all requests settled info: creating Logan_Co_0000 json info: Creating Esri JSON info: Creating GeoJSON info: Creating Shapefile info: query -> 1000 out of 4293 info: query -> 1020 out of 4293 info: query -> 1040 out of 4293 info: query -> 1060 out of 4293 info: query -> 1080 out of 4293 info: query -> 1100 out of 4293 info: query -> 1120 out of 4293 info: query -> 1140 out of 4293 info: query -> 1160 out of 4293 info: query -> 1180 out of 4293 info: query -> 1200 out of 4293 info: query -> 1220 out of 4293 info: query -> 1240 out of 4293 info: query -> 1260 out of 4293 info: query -> 1280 out of 4293 info: query -> 1300 out of 4293 info: query -> 1320 out of 4293 info: query -> 1340 out of 4293 info: query -> 1360 out of 4293 info: query -> 1380 out of 4293 info: query -> 1400 out of 4293 info: query -> 1420 out of 4293 info: query -> 1440 out of 4293 info: query -> 1460 out of 4293 info: query -> 1480 out of 4293 info: query -> 1500 out of 4293 info: query -> 1520 out of 4293 info: query -> 1540 out of 4293 info: query -> 1560 out of 4293 info: query -> 1580 out of 4293 info: query -> 1600 out of 4293 info: query -> 1620 out of 4293 info: query -> 1640 out of 4293 info: query -> 1660 out of 4293 info: query -> 1680 out of 4293 info: query -> 1700 out of 4293 info: query -> 1720 out of 4293 info: query -> 1740 out of 4293 info: query -> 1760 out of 4293 info: query -> 1780 out of 4293 info: query -> 1800 out of 4293 info: query -> 1820 out of 4293 info: query -> 1840 out of 4293 info: query -> 1860 out of 4293 info: query -> 1880 out of 4293 info: query -> 1900 out of 4293 info: query -> 1920 out of 4293 info: query -> 1940 out of 4293 info: query -> 1960 out of 4293 info: query -> 1980 out of 4293 info: all requests settled info: creating Logan_Co_0001 json info: Creating Esri JSON info: Creating GeoJSON info: Creating Shapefile info: query -> 2000 out of 4293 info: query -> 2020 out of 4293 info: query -> 2040 out of 4293 info: query -> 2060 out of 4293 info: query -> 2080 out of 4293 info: query -> 2100 out of 4293 info: query -> 2120 out of 4293 info: query -> 2140 out of 4293 info: query -> 2160 out of 4293 info: query -> 2180 out of 4293 info: query -> 2200 out of 4293 info: query -> 2220 out of 4293 info: query -> 2240 out of 4293 info: query -> 2260 out of 4293 info: query -> 2280 out of 4293 info: query -> 2300 out of 4293 info: query -> 2320 out of 4293 info: query -> 2340 out of 4293 info: query -> 2360 out of 4293 info: query -> 2380 out of 4293 info: query -> 2400 out of 4293 info: query -> 2420 out of 4293 info: query -> 2440 out of 4293 info: query -> 2460 out of 4293 info: query -> 2480 out of 4293 info: query -> 2500 out of 4293 info: query -> 2520 out of 4293 info: query -> 2540 out of 4293 info: query -> 2560 out of 4293 info: query -> 2580 out of 4293 info: query -> 2600 out of 4293 info: query -> 2620 out of 4293 info: query -> 2640 out of 4293 info: query -> 2660 out of 4293 info: query -> 2680 out of 4293 info: query -> 2700 out of 4293 info: query -> 2720 out of 4293 info: query -> 2740 out of 4293 info: query -> 2760 out of 4293 info: query -> 2780 out of 4293 info: query -> 2800 out of 4293 info: query -> 2820 out of 4293 info: query -> 2840 out of 4293 info: query -> 2860 out of 4293 info: query -> 2880 out of 4293 info: query -> 2900 out of 4293 info: query -> 2920 out of 4293 info: query -> 2940 out of 4293 info: query -> 2960 out of 4293 info: query -> 2980 out of 4293 info: all requests settled info: creating Logan_Co_0002 json info: Creating Esri JSON info: Creating GeoJSON info: Creating Shapefile info: query -> 3000 out of 4293 info: query -> 3020 out of 4293 info: query -> 3040 out of 4293 info: query -> 3060 out of 4293 info: query -> 3080 out of 4293 info: query -> 3100 out of 4293 info: query -> 3120 out of 4293 info: query -> 3140 out of 4293 info: query -> 3160 out of 4293 info: query -> 3180 out of 4293 info: query -> 3200 out of 4293 info: query -> 3220 out of 4293 info: query -> 3240 out of 4293 info: query -> 3260 out of 4293 info: query -> 3280 out of 4293 info: query -> 3300 out of 4293 info: query -> 3320 out of 4293 info: query -> 3340 out of 4293 info: query -> 3360 out of 4293 info: query -> 3380 out of 4293 info: query -> 3400 out of 4293 info: query -> 3420 out of 4293 info: query -> 3440 out of 4293 info: query -> 3460 out of 4293 info: query -> 3480 out of 4293 info: query -> 3500 out of 4293 info: query -> 3520 out of 4293 info: query -> 3540 out of 4293 info: query -> 3560 out of 4293 info: query -> 3580 out of 4293 info: query -> 3600 out of 4293 info: query -> 3620 out of 4293 info: query -> 3640 out of 4293 info: query -> 3660 out of 4293 info: query -> 3680 out of 4293 info: query -> 3700 out of 4293 info: query -> 3720 out of 4293 info: query -> 3740 out of 4293 info: query -> 3760 out of 4293 info: query -> 3780 out of 4293 info: query -> 3800 out of 4293 info: query -> 3820 out of 4293 info: query -> 3840 out of 4293 info: query -> 3860 out of 4293 info: query -> 3880 out of 4293 info: query -> 3900 out of 4293 info: query -> 3920 out of 4293 info: query -> 3940 out of 4293 info: query -> 3960 out of 4293 info: query -> 3980 out of 4293 info: all requests settled info: creating Logan_Co_0003 json info: Creating Esri JSON info: Creating GeoJSON info: Creating Shapefile info: query -> 4000 out of 4293 info: query -> 4020 out of 4293 info: query -> 4040 out of 4293 info: query -> 4060 out of 4293 info: query -> 4080 out of 4293 info: query -> 4100 out of 4293 info: query -> 4120 out of 4293 info: query -> 4140 out of 4293 info: query -> 4160 out of 4293 info: query -> 4180 out of 4293 info: query -> 4200 out of 4293 info: query -> 4220 out of 4293 info: query -> 4240 out of 4293 info: query -> 4260 out of 4293 info: query -> 4280 out of 4293 info: all requests settled info: creating Logan_Co_0004 json info: Creating Esri JSON info: Creating GeoJSON info: Creating Shapefile

After completion there is no shapefile in the output folder. I've read through the other issues, but can't find anything that is applicable. Any help would be appreciated @tannerjt

TypeError: Cannot read property 'trim' of undefined

Incorrect code for the final chunk in a JSON

The line
ids = objectIds.slice(i * 100, objectIds[objectIds.length-1]);
should be corrected to
ids = objectIds.slice(i * 100, objectIds.length);

ReferenceError: geojsonStream is not defined

Hi @tannerjt, I'm getting this error when I try to run the package.

ReferenceError: geojsonStream is not defined
    at Timeout.setTimeout (/home/ec2-user/.nvm/versions/node/v6.0.0/lib/node_modules/agsout-modified/index.js:143:11)
    at tryOnTimeout (timers.js:224:11)
    at Timer.listOnTimeout (timers.js:198:5)

I've modified the chunk size to 1000 instead of 100 and my services.txt is below:

https://maps.bexar.org/arcgis/rest/services/Parcels/MapServer/0|parcels|1000

Any ideas what's going on? When I run npm list, the geojson-stream package is listed, so I'm not sure what else to try.

Thanks for any suggestions!

failed to export bigsize data

Here is a problem when export bigsize data from json to geojson & shapefile. how can i solve this issue.

please help me for this issue.
Thank You.