Comments (5)
@FiV0 thanks for reporting the issue! Could you please share the link to the repository with Clojure integration and the failing example? I'll look into it tonight.
from astminer.
@egor-bogomolov
This branch has the files: https://github.com/FiV0/astminer/tree/clojure-support
You just need to run /.gradlew test
and one test will fail.
To get the stacktrace you need to comment out the try statement in the ClojureParser.kt
from astminer.
@FiV0
I've reproduced the failure yesterday but didn't find out the fundamental reason. I will give it one more shot today.
from astminer.
Sorry for the late reply, but I fixed the problem. For Clojure, some characters like braces do not have a special type in grammar and we need a special workaround for this case.
To fix the issue, update TreeUtil:convertTerminal as follows:
val typeName = vocabulary.getSymbolicName(terminalNode.symbol.type) ?: "ESCAPED"
return SimpleNode(typeName, parent, terminalNode.symbol.text)
And add a null-check in TreeUtil:convertRuleContext: ruleContext.children.forEach
-> ruleContext.children?.forEach
I will update our implementation to avoid problems of this type.
from astminer.
We completely refactor our pipeline and make it easier to add new languages. If you are still interested in adding Clojure support, navigate to documentation and see examples of existing parsers.
If you still have questions, don't hesitate to reopen this issue.
from astminer.
Related Issues (20)
- Error running astminer HOT 24
- Error Parsing C++ Files for Code2Seq HOT 15
- Integrating astminer with code2vec for C source codes HOT 6
- need help HOT 3
- File information of path_context result HOT 2
- different paths for same code content in python HOT 2
- problem with running "gradle shadowJar" HOT 4
- cli.jar HOT 8
- Looping over AST trees to generate paths between terminals HOT 2
- can astminer extract control flow of a source code? HOT 5
- Fuzzy error
- How to add a new language? HOT 1
- Is it possible to extract shortest path between two nodes?
- Output format code2vec HOT 2
- Manage the number of output path contexts
- "No such file or directory" error while parsing C++ code HOT 1
- C/C++ tests fail on M1
- Plugin [id: 'org.jetbrains.dokka', version: '1.4.32'] was not found in any of the following sources:
- Which version of JDK do I need to install before running this project?
- About generating input data for Code2Vec from C files
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from astminer.