The file server-application.conf generated when compiling project (master branch) has missing some new configuration parameters.

Compiled file:
meta-server.akka.actor.provider = "akka.cluster.ClusterActorRefProvider"
meta-server.akka.cluster.auto-down = on
meta-server.akka.extensions = ["akka.contrib.pattern.ClusterReceptionistExtension"]
meta-server.akka.log-dead-letters = 0
meta-server.akka.log-dead-letters-during-shutdown = off
meta-server.akka.remote.netty.tcp.hostname = "127.0.0.1"
meta-server.akka.remote.netty.tcp.port = 13420
meta-server.akka.cluster.seed-nodes = ["akka.tcp://[email protected]:13420"]
meta-server.akka.remote.netty.tcp.maximum-frame-size = 30MiB
meta-server.config.cassandra.port = 9042
meta-server.config.cluster.name = "SDSDistMetaServer"
meta-server.config.cluster.actor = "meta-server"
meta-server.config.cassandra.hosts = ["127.0.0.1"]

Desired file (kind of):
meta-server.akka.actor.provider = "akka.cluster.ClusterActorRefProvider"
meta-server.akka.cluster.auto-down = on
meta-server.akka.extensions = ["akka.contrib.pattern.ClusterReceptionistExtension"]
meta-server.akka.log-dead-letters = 0
meta-server.akka.log-dead-letters-during-shutdown = off
meta-server.akka.remote.netty.tcp.hostname = "127.0.0.1"
meta-server.akka.remote.netty.tcp.port = 13420
meta-server.akka.cluster.seed-nodes = ["akka.tcp://[email protected]:13420"]
meta-server.akka.remote.netty.tcp.maximum-frame-size = 30MiB
meta-server.config.cassandra.port = 9042
meta-server.config.cluster.name = "SDSDistMetaServer"
meta-server.config.cluster.actor = "meta-server"
meta-server.config.cassandra.hosts = ["127.0.0.1"]
meta-server.config.spark.master = "spark://sandbox.stratio.com:7077"
meta-server.config.spark.classpath = "/opt/sds/spark/lib/"

meta-server.config.kafka.server = "127.0.0.1"
meta-server.config.kafka.port = 6667
meta-server.config.zookeeper.server = "127.0.0.1"
meta-server.config.zookeeper.port = 2181

meta-server.config.streaming.duration = 2000
meta-server.config.streaming.groupId = "stratio"

It is necessary to include a white space at the end of the statement in the executeQuery method.

MetaServer log in a meta-sh query:

User {9b15c2ba-7eed-4007-a7fb-7b21c9e04c44} ks: {test} stmt: {select * from users; } id: a1c22a3a-ffcb-4c46-83e3-de59e084c737
14/06/30 15:11:40 INFO executor.CassandraExecutor: Executing step: (CASSANDRA) SELECT * FROM users

It would be useful to define an enumeration of catalog types in such a way that system catalogs are fully identified so the user can filter them.

Add Support for select statements through streaming with Where clauses

This happens while we try to execute meta-core mvn tests (mvn -pl meta-core test), having an empty local repository. It seems to be unable to resolve dependencies by itself. Here the console log:

[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 2:08.741s
[INFO] Finished at: Tue Jun 10 10:35:09 CEST 2014
[INFO] Final Memory: 12M/90M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project meta-core: Could not resolve dependencies for project com.stratio.meta:meta-core:jar:0.0.5-SNAPSHOT: Could not find artifact com.stratio.meta:meta-common:jar:0.0.5-SNAPSHOT in stratio-snapshots (http://nexus.strat.io:8081/nexus/content/repositories/snapshots) -> [Help 1]

Similiar to the CQL Statement: COPY table_name (column, ...) FROM 'file_name';

When we launch a select query and the result returns 0 rows, we show the messager "OK" and we should show a empty table.

SELECT 'namE' FROM selectdemo.users ;
->
com.stratio.meta.common.exceptions.ParsingException
at com.stratio.meta.driver.result.SyncResultHandler.processError(SyncResultHandler.scala:71)
at com.stratio.meta.driver.actor.ProxyActor$$anonfun$receive$1.applyOrElse(ProxyActor.scala:130)
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498)
at akka.actor.ActorCell.invoke(ActorCell.scala:456)
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237)
at akka.dispatch.Mailbox.run(Mailbox.scala:219)
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)

SELECT bool,'namE' FROM selectdemo.users ;
->
com.stratio.meta.common.exceptions.ParsingException
at com.stratio.meta.driver.result.SyncResultHandler.processError(SyncResultHandler.scala:71)
at com.stratio.meta.driver.actor.ProxyActor$$anonfun$receive$1.applyOrElse(ProxyActor.scala:130)
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498)
at akka.actor.ActorCell.invoke(ActorCell.scala:456)
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237)
at akka.dispatch.Mailbox.run(Mailbox.scala:219)
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)

After creating the required keyspace and tables (directly on cassandra), when tests try to execute "create lucene index if not exists tindex on tkeyspace.ttable8 (tinfo);" query through the driver, there appears an error as result: "not found answer".
This is the meta-server log:

14/05/14 09:27:24 ERROR parser.Parser: Cannot parse statement
java.lang.IllegalArgumentException: No enum constant com.stratio.meta.core.structures.IndexType.lucene
at java.lang.Enum.valueOf(Enum.java:236)
at com.stratio.meta.core.structures.IndexType.valueOf(IndexType.java:29)
at com.stratio.meta.core.statements.CreateIndexStatement.setIndexType(CreateIndexStatement.java:128)
at com.stratio.meta.core.grammar.generated.MetaParser.createIndexStatement(MetaParser.java:665)
at com.stratio.meta.core.grammar.generated.MetaParser.metaStatement(MetaParser.java:3373)
at com.stratio.meta.core.grammar.generated.MetaParser.query(MetaParser.java:3468)
at com.stratio.meta.core.parser.Parser.parseStatement(Parser.java:54)
at com.stratio.meta.server.actors.ParserActor$$anonfun$receive$1.applyOrElse(ParserActor.scala:40)
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498)
at akka.actor.ActorCell.invoke(ActorCell.scala:456)
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237)
at akka.dispatch.Mailbox.run(Mailbox.scala:219)
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:385)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
14/05/14 09:27:24 ERROR actor.OneForOneStrategy:
java.lang.NullPointerException
at java.lang.StringBuilder.(StringBuilder.java:109)
at com.stratio.meta.core.utils.ParserUtils.getQueryWithSign(ParserUtils.java:107)
at com.stratio.meta.core.utils.ErrorsHelper.toString(ErrorsHelper.java:45)
at com.stratio.meta.core.utils.ErrorsHelper.toString(ErrorsHelper.java:56)
at com.stratio.meta.core.parser.Parser.parseStatement(Parser.java:64)
at com.stratio.meta.server.actors.ParserActor$$anonfun$receive$1.applyOrElse(ParserActor.scala:40)
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498)
at akka.actor.ActorCell.invoke(ActorCell.scala:456)
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237)
at akka.dispatch.Mailbox.run(Mailbox.scala:219)
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:385)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
14/05/14 09:28:24 ERROR parser.Parser: Cannot parse statement
java.lang.IllegalArgumentException: No enum constant com.stratio.meta.core.structures.IndexType.lucene
at java.lang.Enum.valueOf(Enum.java:236)
at com.stratio.meta.core.structures.IndexType.valueOf(IndexType.java:29)
at com.stratio.meta.core.statements.CreateIndexStatement.setIndexType(CreateIndexStatement.java:128)
at com.stratio.meta.core.grammar.generated.MetaParser.createIndexStatement(MetaParser.java:665)
at com.stratio.meta.core.grammar.generated.MetaParser.metaStatement(MetaParser.java:3373)
at com.stratio.meta.core.grammar.generated.MetaParser.query(MetaParser.java:3468)
at com.stratio.meta.core.parser.Parser.parseStatement(Parser.java:54)
at com.stratio.meta.server.actors.ParserActor$$anonfun$receive$1.applyOrElse(ParserActor.scala:40)
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498)
at akka.actor.ActorCell.invoke(ActorCell.scala:456)
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237)
at akka.dispatch.Mailbox.run(Mailbox.scala:219)
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:385)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
14/05/14 09:28:24 ERROR actor.OneForOneStrategy:
java.lang.NullPointerException
at java.lang.StringBuilder.(StringBuilder.java:109)
at com.stratio.meta.core.utils.ParserUtils.getQueryWithSign(ParserUtils.java:107)
at com.stratio.meta.core.utils.ErrorsHelper.toString(ErrorsHelper.java:45)
at com.stratio.meta.core.utils.ErrorsHelper.toString(ErrorsHelper.java:56)
at com.stratio.meta.core.parser.Parser.parseStatement(Parser.java:64)
at com.stratio.meta.server.actors.ParserActor$$anonfun$receive$1.applyOrElse(ParserActor.scala:40)
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498)
at akka.actor.ActorCell.invoke(ActorCell.scala:456)
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237)
at akka.dispatch.Mailbox.run(Mailbox.scala:219)
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:385)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
14/05/14 09:29:24 ERROR parser.Parser: Cannot parse statement
java.lang.IllegalArgumentException: No enum constant com.stratio.meta.core.structures.IndexType.lucene
at java.lang.Enum.valueOf(Enum.java:236)
at com.stratio.meta.core.structures.IndexType.valueOf(IndexType.java:29)
at com.stratio.meta.core.statements.CreateIndexStatement.setIndexType(CreateIndexStatement.java:128)
at com.stratio.meta.core.grammar.generated.MetaParser.createIndexStatement(MetaParser.java:665)
at com.stratio.meta.core.grammar.generated.MetaParser.metaStatement(MetaParser.java:3373)
at com.stratio.meta.core.grammar.generated.MetaParser.query(MetaParser.java:3468)
at com.stratio.meta.core.parser.Parser.parseStatement(Parser.java:54)
at com.stratio.meta.server.actors.ParserActor$$anonfun$receive$1.applyOrElse(ParserActor.scala:40)
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498)
at akka.actor.ActorCell.invoke(ActorCell.scala:456)
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237)
at akka.dispatch.Mailbox.run(Mailbox.scala:219)
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:385)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
14/05/14 09:29:24 ERROR actor.OneForOneStrategy:
java.lang.NullPointerException
at java.lang.StringBuilder.(StringBuilder.java:109)
at com.stratio.meta.core.utils.ParserUtils.getQueryWithSign(ParserUtils.java:107)
at com.stratio.meta.core.utils.ErrorsHelper.toString(ErrorsHelper.java:45)
at com.stratio.meta.core.utils.ErrorsHelper.toString(ErrorsHelper.java:56)
at com.stratio.meta.core.parser.Parser.parseStatement(Parser.java:64)
at com.stratio.meta.server.actors.ParserActor$$anonfun$receive$1.applyOrElse(ParserActor.scala:40)
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498)
at akka.actor.ActorCell.invoke(ActorCell.scala:456)
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237)
at akka.dispatch.Mailbox.run(Mailbox.scala:219)
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:385)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)

Insert statement: INSERT INTO users (user_id, email) VALUES (100, '[email protected]') would store the single quotes along with the email in the text column.

Insert into doesn't verify that the name of the columns exist in the table.

Implement Insert Into Statement with Streaming

This query:

create table demo.temp6 (c1 int, c2 varchar, PRIMARY KEY (c2), c3 varchar, PRIMARY KEY (c3));

, creates a table with primary key c2 & c3. We might limit the grammar to accept just one PRIMARY KEY clause after fields definition. E.g:

create table demo.temp6 (c1 int, c2 varchar, c3 varchar, PRIMARY KEY (c2, c3));

USE 'tkeyspaceSHIFT';
->
com.stratio.meta.common.exceptions.ParsingException: �[31mParser exception: �[0m
Error recognized: line 1:4: mismatched input 'tkeyspaceSHIFT' expecting "LETTER(LETTER|DIGIT|_)*"
USE �[35m|�[0m'tkeyspaceSHIFT';
Did you mean: "USE"?

USE "tkeyspaceSHIFT";
com.stratio.meta.common.exceptions.ParsingException: �[31mParser exception: �[0m
Error recognized: line 1:4: extraneous input '"' expecting "LETTER(LETTER|DIGIT|_)*"
USE �[35m|�[0m"tkeyspaceSHIFT";
Did you mean: "USE"?

at com.stratio.meta.driver.result.SyncResultHandler.processError(SyncResultHandler.scala:71)
at com.stratio.meta.driver.actor.ProxyActor$$anonfun$receive$1.applyOrElse(ProxyActor.scala:130)
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498)
at akka.actor.ActorCell.invoke(ActorCell.scala:456)
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237)
at akka.dispatch.Mailbox.run(Mailbox.scala:219)
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)

INSERT INTO should be able to infer the columns using the order specified during table creation.

For instance,

CREATE TABLE demo.users ( name varchar, gender varchar, email varchar, age int, bool boolean, phrase varchar, PRIMARY KEY ((name, gender), email, age));

Insert test data without specifying the columns

INSERT INTO demo.users VALUES ('name_0', 'male', '[email protected]', 10, true, '');
INSERT INTO demo.users VALUES ('name_1', 'male', '[email protected]', 11, true, '');
I

Create table doesn't allow omitting the keyspace name even if the user has executed the use keyspace query previously. It appears "error : null";

A new enum ErrorType should be added to point the user to the specific type of error returned.

Remove the getDriverStatement method from MetaStatement and move its functionality to the translateToCQL method if applied.

Executing the mistyped query "SELECT * FROM selectdemo.users LIMIT;" leads to "Error: Not found answer" (after waiting for maybe two minutes). Should it throw a Syntax error?

Metaserver Log

14/05/07 11:34:16 ERROR parser.Parser: Cannot parse statement
java.lang.NumberFormatException: For input string: ""
at java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
at java.lang.Integer.parseInt(Integer.java:492)
at java.lang.Integer.parseInt(Integer.java:527)
at com.stratio.meta.core.grammar.generated.MetaParser.selectStatement(MetaParser.java:1935)
at com.stratio.meta.core.grammar.generated.MetaParser.metaStatement(MetaParser.java:3273)
at com.stratio.meta.core.grammar.generated.MetaParser.query(MetaParser.java:3468)
at com.stratio.meta.core.parser.Parser.parseStatement(Parser.java:54)
at com.stratio.meta.server.actors.ParserActor$$anonfun$receive$1.applyOrElse(ParserActor.scala:40)
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498)
at akka.actor.ActorCell.invoke(ActorCell.scala:456)
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237)
at akka.dispatch.Mailbox.run(Mailbox.scala:219)
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:385)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
14/05/07 11:34:16 ERROR actor.OneForOneStrategy:
java.lang.NullPointerException
at java.lang.StringBuilder.(StringBuilder.java:109)
at com.stratio.meta.core.utils.ParserUtils.getQueryWithSign(ParserUtils.java:107)
at com.stratio.meta.core.utils.ErrorsHelper.toString(ErrorsHelper.java:45)
at com.stratio.meta.core.utils.ErrorsHelper.toString(ErrorsHelper.java:56)
at com.stratio.meta.core.parser.Parser.parseStatement(Parser.java:64)
at com.stratio.meta.server.actors.ParserActor$$anonfun$receive$1.applyOrElse(ParserActor.scala:40)
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498)
at akka.actor.ActorCell.invoke(ActorCell.scala:456)
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237)
at akka.dispatch.Mailbox.run(Mailbox.scala:219)
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:385)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
14/05/07 11:35:16 ERROR parser.Parser: Cannot parse statement
java.lang.NumberFormatException: For input string: ""
at java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
at java.lang.Integer.parseInt(Integer.java:492)
at java.lang.Integer.parseInt(Integer.java:527)
at com.stratio.meta.core.grammar.generated.MetaParser.selectStatement(MetaParser.java:1935)
at com.stratio.meta.core.grammar.generated.MetaParser.metaStatement(MetaParser.java:3273)
at com.stratio.meta.core.grammar.generated.MetaParser.query(MetaParser.java:3468)
at com.stratio.meta.core.parser.Parser.parseStatement(Parser.java:54)
at com.stratio.meta.server.actors.ParserActor$$anonfun$receive$1.applyOrElse(ParserActor.scala:40)
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498)
at akka.actor.ActorCell.invoke(ActorCell.scala:456)
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237)
at akka.dispatch.Mailbox.run(Mailbox.scala:219)
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:385)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
14/05/07 11:35:16 ERROR actor.OneForOneStrategy:
java.lang.NullPointerException
at java.lang.StringBuilder.(StringBuilder.java:109)
at com.stratio.meta.core.utils.ParserUtils.getQueryWithSign(ParserUtils.java:107)
at com.stratio.meta.core.utils.ErrorsHelper.toString(ErrorsHelper.java:45)
at com.stratio.meta.core.utils.ErrorsHelper.toString(ErrorsHelper.java:56)
at com.stratio.meta.core.parser.Parser.parseStatement(Parser.java:64)
at com.stratio.meta.server.actors.ParserActor$$anonfun$receive$1.applyOrElse(ParserActor.scala:40)
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498)
at akka.actor.ActorCell.invoke(ActorCell.scala:456)
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237)
at akka.dispatch.Mailbox.run(Mailbox.scala:219)
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:385)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)

When we try to connect Microsoft Excel with the ODBC, it requieres "CATALOG_ONLY" and "TABLES" Metadata.

We assume that it could happen in other Software that use the ODBC

Update autocompletion in shell with new words of the grammar

When we execute the next statement:

"SELECT name, age FROM demo.users WHERE name = 'name_5' AND age = 15;"

we get:

"Error: Cannot execute this query as it might involve data filtering and thus may have unpredictable performance. If you want to execute this query despite the performance unpredictability, use ALLOW FILTERING"

Therefore, this statement should be executed with Deep instead of Cassandra

When using an installed meta-server, the following trace appears when the statement cannot be parsed.

[MetaServer] 01-07-2014 09:25:16.193 [ERROR|ParserUtils] Cannot read replacement file
java.io.FileNotFoundException: /opt/sds/meta/meta-core/src/main/resources/com/stratio/meta/parser/tokens.txt (No existe el archivo o el directorio)
at java.io.FileInputStream.open(Native Method)
at java.io.FileInputStream.(FileInputStream.java:146)
at java.io.FileInputStream.(FileInputStream.java:101)
at com.stratio.meta.core.utils.ParserUtils.getReplacement(ParserUtils.java:231)
at com.stratio.meta.core.utils.ParserUtils.translateToken(ParserUtils.java:207)
at com.stratio.meta.core.utils.AntlrError.toStringWithTokenTranslation(AntlrError.java:50)
at com.stratio.meta.core.utils.ErrorsHelper.toString(ErrorsHelper.java:48)
at com.stratio.meta.core.parser.Parser.parseStatement(Parser.java:74)
at com.stratio.meta.server.actors.ParserActor$$anonfun$receive$1.applyOrElse(ParserActor.scala:40)
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498)
at akka.actor.ActorCell.invoke(ActorCell.scala:456)
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237)
at akka.dispatch.Mailbox.run(Mailbox.scala:219)
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:385)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)

Querying to delete float and double values, makes the driver throw an exception:

"DELETE FROM selectdemo.doublepk WHERE double_column=1.08;"
throws the following exception:

com.stratio.meta.common.exceptions.ValidationException: Column double_column of type class java.lang.Double does not accept class java.lang.String values (1.08)
at com.stratio.meta.driver.result.SyncResultHandler.processError(SyncResultHandler.scala:73)
at com.stratio.meta.driver.actor.ProxyActor$$anonfun$receive$1.applyOrElse(ProxyActor.scala:130)
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498)
at akka.actor.ActorCell.invoke(ActorCell.scala:456)
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237)
at akka.dispatch.Mailbox.run(Mailbox.scala:219)
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)

"DELETE FROM selectdemo.floatpk WHERE float_column=1.07;"
com.stratio.meta.common.exceptions.ValidationException: Column float_column of type class java.lang.Float does not accept class java.lang.String values (1.07)
at com.stratio.meta.driver.result.SyncResultHandler.processError(SyncResultHandler.scala:73)
at com.stratio.meta.driver.actor.ProxyActor$$anonfun$receive$1.applyOrElse(ProxyActor.scala:130)
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498)
at akka.actor.ActorCell.invoke(ActorCell.scala:456)
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237)
at akka.dispatch.Mailbox.run(Mailbox.scala:219)
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)

Setting a reserved name to a column when creating table leads to a confusing error to the user. Maybe error should look more like: Column's stratio_lucene_index_1 name format incorrect: Cannot contain begining tag (stratio_lucene_)

log:

metash-sh:idiaz:test> CREATE TABLE test.users ( name varchar, gender varchar, email varchar, age int, bool boolean, phrase varchar, stratio_lucene_index_1 varchar, PRIMARY KEY ((name, gender), email, age)) WITH comment='test table';
Error: Column stratio_lucene_index_1 with datatype varchar not supported.

Add support to CREATE LUCENE INDEX to merge the options specified by the users with the default options declared in the code.

Effective Keyspace of a select statement is not well identify after metaserver restart when the query goes to cassandra.

Meta-sh log:
metash-sh:jjlopez:stratiotest> select * from email;
Error: no keyspace has been specified

MetaServer log:
User {baaeee05-aa13-45dd-b831-d1b953b8a910} ks: {stratiotest} stmt: {select * from email; } id: 12df881b-c0f4-4e02-8ee1-6b282264bc01

• effectiveKs: stratiotest ksInc:false ks: null sessionKs: stratiotest

Add functionality to the USE statement in order to set the current keyspace as the root keyspace

USE demo;
Result: OK
EXPLAIN PLAN FOR SELECT u.gender, u.name, sum(u.age), i.info from users u inner join users_info i on u.name = i.link_name group by u.gender;
Result: Target keyspace missing or no keyspace has been selected.

We have an error associated to the INNER JOIN queries validation. When we apply a WHERE clause related to the second table, we get a validation error. I seems to be related to the fact that the root statement of the statements tree is validated along with the WHERE clause, which shouldn't be included for that one; it just must be validated with the second leaf statement. E.g.

SELECT * FROM demo.users INNER JOIN demo.types ON users.name = types.varchar_column WHERE types.int_column > 104;

, and we get:

Result: Column [int_column] of type [class java.lang.Integer] does not accept class java.lang.Long values (104)

    String user=System.getProperty("user.name");
    String keyspace="test";
    try{
            Result metaResult=metadriver.executeQuery(user, keyspace, q);
    ...

It doesn't matter what I write on the keyspace variable; it won't find the table "users" on the query "select * from users", setting "keyspace" to "test", but it will find it when doing "select * from test.users" no mattering what the value of the keyspace variable is.

When a group by select statement is launched, the order in which the columns are returned does not follow the one specified in the query selectors.

metash-sh:dhiguero> select sum(age), email, gender from demo.users group by gender;
QID: c2c81fc2-ba32-4847-a56f-9b25d8d322f6

metash-sh:dhiguero>
Result: QID:c2c81fc2-ba32-4847-a56f-9b25d8d322f6

Partial result: true

| gender | email | SUM(age) |

| female | [email protected] | 56 |

| male | [email protected] | 704 |

When we trying to do a BasicDriver disconnect, and then, connect again because the configuration of connection change(Example; different IP of MetaServer ), the functionality is not quite correct, because BasicDriver only get the connection configuration when creates the object and not when we use the connect method.

When a deep process is executed, we collect all the rows and we don't use the limit of the query.

If we execute a simple direct Cassandra query:

select * from users;

, we get the 'stratio_lucene_index_1' column as part of the result. We must hide it.

SELECT count(*) FROM twitter.tweets WHERE userverified MATCH true;

14/07/03 11:46:29 ERROR executor.DeepExecutor: Spark exception
java.lang.ClassCastException: com.stratio.meta.core.structures.SelectionCount cannot be cast to com.stratio.meta.core.structures.SelectionList
at com.stratio.meta.deep.Bridge.executeLeafNode(Bridge.java:151)
at com.stratio.meta.deep.Bridge.execute(Bridge.java:293)
at com.stratio.meta.core.executor.DeepExecutor.execute(DeepExecutor.java:72)
at com.stratio.meta.core.utils.Tree.executeMyself(Tree.java:184)
at com.stratio.meta.core.utils.Tree.executeTreeDownTop(Tree.java:213)
at com.stratio.meta.core.executor.Executor.executeQuery(Executor.java:107)

When I try to execute the following query:

SELECT u.gender, u.name, sum(u.age), i.info from users u inner join users_info i on u.name = i.link_name group by u.gender;

, I obtain an error:

Result: Spark exception:
No column with name info has been found on table demo.users

It seems the Bridge is trying to look for the info field into the users table but it's a field from the users_info one.

metash-sh:carlos> insert into test.users (user_name,birth_year) values('juanjo',1962);
Error: Column birth_year of type class java.lang.Long does not accept class java.lang.Integer values (1962)
metash-sh:carlos>

Column definition is maintaned per cell in a row of a ResultSet. This information is redundant and should be removed.

Dataset:
Group by
CREATE TABLE selectdemo.users_groupby ( name varchar, gender varchar, email varchar, age int, bool boolean, phrase varchar, PRIMARY KEY ((name, gender), email, age)) WITH comment='Users table GROUP BY SPECIAL EDITION :d';
INSERT INTO selectdemo.users_groupby (name, gender, email, age, bool, phrase) VALUES ('name_0', 'male', '[email protected]', 10, true, '');
INSERT INTO selectdemo.users_groupby (name, gender, email, age, bool, phrase) VALUES ('name_1', 'female', '[email protected]', 11, true, '');
INSERT INTO selectdemo.users_groupby (name, gender, email, age, bool, phrase) VALUES ('name_2', 'male', '[email protected]', 12, true, '');
INSERT INTO selectdemo.users_groupby (name, gender, email, age, bool, phrase) VALUES ('name_3', 'female', '[email protected]', 13, true, '');
INSERT INTO selectdemo.users_groupby (name, gender, email, age, bool, phrase) VALUES ('name_4', 'male', '[email protected]', 14, true, '');
INSERT INTO selectdemo.users_groupby (name, gender, email, age, bool, phrase) VALUES ('name_5', 'female', '[email protected]', 15, false, '');
INSERT INTO selectdemo.users_groupby (name, gender, email, age, bool, phrase) VALUES ('name_6', 'male', '[email protected]', 16, false, '');
INSERT INTO selectdemo.users_groupby (name, gender, email, age, bool, phrase) VALUES ('name_7', 'female', '[email protected]', 17, false, '');
INSERT INTO selectdemo.users_groupby (name, gender, email, age, bool, phrase) VALUES ('name_8', 'male', '[email protected]', 18, false, '');
INSERT INTO selectdemo.users_groupby (name, gender, email, age, bool, phrase) VALUES ('name_9', 'male', '[email protected]', 19, false, '');

Test query:
SELECT gender, sum(age) FROM selectdemo.users GROUP BY bool

Test result:
2014-06-18 17:05:41 DEBUG SelectTests:970 - ResultSet Meta
2014-06-18 17:05:41 DEBUG SelectTests:971 -

| gender| SUM(age)|

| male | 89 |
| female | 56 |

2014-06-18 17:05:41 DEBUG SelectTests:972 - ResultSet Expected
2014-06-18 17:05:41 DEBUG SelectTests:973 -

| gender| SUM(age)|

| male | 89 |
| female | 56 |

ResultSet - ColumnMetadata ResultSet Meta - size 10 -> name, gender, email... (all fields)
ExpectedResultSet - ColumnMetadata ResultSet Meta - size 2 -> gender, sum(age)

BigInt, Double, and Float values are not assigned and specific type of Term, and therefore the type validation fails. The grammar should be modified to accommodate these types.

2014-05-06 09:57:42 DEBUG DeleteTests:181 - QUERY- DELETE FROM selectdemo.types WHERE bigint_column=10006;
2014-05-06 09:57:42 DEBUG DeleteTests:183 - ERROR- Column bigint_column of type class java.lang.Long does not accept class java.lang.Integer values (10006)
2014-05-06 09:57:42 DEBUG DeleteTests:215 - QUERY- DELETE FROM selectdemo.types WHERE double_column=1.08;
2014-05-06 09:57:42 DEBUG DeleteTests:217 - ERROR- Column double_column of type class java.lang.Double does not accept class java.lang.String values (1.08)
2014-05-06 09:57:42 DEBUG DeleteTests:198 - QUERY- DELETE FROM selectdemo.types WHERE float_column=1.07;
2014-05-06 09:57:42 DEBUG DeleteTests:200 - ERROR- Column float_column of type class java.lang.Float does not accept class java.lang.String values (1.07)

metash-sh:root> select * from demo.users_info;
QID: aa58c1cd-6fb2-44f6-980e-25ddb29e10cc

metash-sh:root>
Result: QID: aa58c1cd-6fb2-44f6-980e-25ddb29e10cc

Partial result: true

| link_name | link_email | info | stratio_lucene_users_info |