snowplow-archive / bigquery-loader-cli Goto Github PK

Similar to: https://github.com/snowplow/scalding-example-project/blob/master/.travis.yml

Basically making it clear that this relates to Snowplow enriched events

In other words:

 /*
* Copyright (c) 2014 Snowplow Analytics Ltd.
* All rights reserved.
*
* This program is licensed to you under the Apache License Version 2.0,
* and you may not use this file except in compliance with the Apache
* License Version 2.0.
* You may obtain a copy of the Apache License Version 2.0 at
* http://www.apache.org/licenses/LICENSE-2.0.
*
* Unless required by applicable law or agreed to in writing,
* software distributed under the Apache License Version 2.0 is distributed
* on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND,
* either express or implied.
*
* See the Apache License Version 2.0 for the specific language
* governing permissions and limitations there under.
*/
package com.snowplowanalytics.snowplow.storage.kinesis.bigquery

See: https://github.com/snowplow/sql-runner

Currently:

package com.snowplowanalytics.snowplow.storage.kinesis.bigquery

Should be:

package com.snowplowanalytics.snowplow.bigquery.loader

or similar

Similar to: https://github.com/snowplow/scalding-example-project#copyright-and-license

Lots of scala-common-enrich dependencies there

Couple of sentences: what is this, who should use it?

For example, the README doesn't tell you yet that this project is writing Snowplow specific events...

I am running this command :
./bigquery-loader-cli-0.1.0 --create-table "moonshot-1349" "dataset_test_1" "table_test_1" part-00000.gzip
It's throwing following error:
FileNotFoundException: java.io.FileNotFoundException: snowplow_bigquery_refresh_token.properties (No such file or directory)
Exception in thread "main" java.lang.NullPointerException
at com.snowplowanalytics.snowplow.bigquery.loader.BigqueryInterface.getCredentials(BigqueryInterface.scala:155)
at com.snowplowanalytics.snowplow.bigquery.loader.BigqueryInterface.loadCredentials(BigqueryInterface.scala:135)
at com.snowplowanalytics.snowplow.bigquery.loader.BigqueryInterface.(BigqueryInterface.scala:110)
at com.snowplowanalytics.snowplow.bigquery.loader.BigqueryLoaderCli$.main(BigqueryLoaderCli.scala:71)
at com.snowplowanalytics.snowplow.bigquery.loader.BigqueryLoaderCli.main(BigqueryLoaderCli.scala)

Is there something I am missing?

See other projects for how to do this...

See: https://github.com/snowplow/sql-runner

No need to keep it in a source control system