codebndr / compiler

The codebender compiler backend.

This repository is part of the codebender.cc maker and artist web platform.

And what's that?

codebender fills the need for reliable, easy to use tools for makers, a need that couldn't be completely fulfilled by any existing solution according to our experience.

Things like installing libraries or the IDE and updating software sometimes were (and still are) quite a painful process. But in addition to the above, the limited features provided (e.g. insufficient highlighting, indentation and autocompletion) got us to start codebender, a completely web-based IDE that requires virtually no installation and offers a great code editor. Plus it stores your sketches on the cloud. Yeah!

With your code on the cloud, you can access your sketches safely even if your laptop is stolen or your hard drive fails! codebender also compiles your code giving you extremely descriptive error descriptions on terrible code. There's even more, you can upload your code to your Arduino straight from the browser.

How does the compiler come into the picture?

The compiler repository includes all the necessary files needed to run the compiler as a service. It receives the code as input and outputs the compiled output if the compilation was successful or the errors present in the code. We provide an easy interface to send the code to the compiler.

Here's a list of open source projects we use

• Clang
• gcc-avr
• avr binutils (avrsize)

For development we've run it on a variety of Linux and Mac OS X machines.

For production we are using Ubuntu Server 12.04. We know the compiler works perfectly on it, so we suggest you using it as well.

How to install

Check out the code in any directory you wish

git clone https://github.com/codebendercc/compiler.git

Then cd in the created directory (if you run the command as is above, it would be named compiler) and run

scripts/install.sh

(don't cd into scripts directory and run install.sh from there, it won't work)

If you now visit http://localhost/status you'll see a JSON response telling you everything's ok: {"success":true,"status":"OK"}

What's next?

Visit the wiki for more information.

How can someone contribute?

Contribution is always welcome whether it is by creating an issue for a bug or suggestion you can't fix yourself or a pull request for something you can.

If you write new code or edit old code please don't forget to add/update relative unit tests that come with it. It is always a good idea to run tests localy to make sure nothing breaks before you create a pull request.

We expect new code to be PSR-2 but we know we carry legacy code with different coding styles. You're welcome to fix that.

compiler's Issues

can not post using python

If I use python to post data to this compiler server api, it returns "invalid input".
I use urllib2 to post. And I found that the request data the server received is not a json.

Google Ending support for packaged apps

Sorry if this is the wrong place for this question, but I was curious to know if you had any plans for how to adjust to Google's plans to end support for packaged apps. I'm using a codebender server with my own packaged app to flash compiled code to the board b/c that seems to be the only way to access the serial port from javascript.

I was wondering if you folks would be willing to share your approach.

Server 404, Installation problem?

I've followed the installation steps on the compiler wiki for 5 times.
Every time it seems to be installed correctly and apache2 service is running, but request to the route "complier/status" returns a 404.
I also tried other example requests in the wiki, but all returns a 404.
I'm using Ubuntu14.04 on AWS EC2.
Please help, Thank you!

If an error occurs during an `exec` call, we get empty output

Issue description and reproduction steps

When providing G++ or Clang with parameter files that contain parentheses in their names, PHP's exec function breaks and you get sth like this on the stderr output (caught in command line):

sh: -c: line 0: syntax error near unexpected token `('
sh: -c: line 0: `avr-g++ -Os -ffunction-sections -fdata-sections -fno-exceptions  -I/arduino-core-files-OSX/v105/hardware/tools/avr/lib/gcc/avr/4.3.2/include -I/arduino-core-files-OSX/v105/hardware/tools/avr/lib/gcc/avr/4.3.2/include-fixed -I/arduino-core-files-OSX/v105/hardware/tools/avr/avr/include  -mmcu=atmega328p -DARDUINO=105 -DF_CPU=16000000 -DUSB_VID=null -DUSB_PID=null -MMD  -I/external_cores/override_cores/arduino/ -I/arduino-core-files-OSX/v105/hardware/arduino/cores/arduino -I/arduino-core-files-OSX/v105/hardware/arduino/variants/standard -I/tmp/compiler.elVKPg/libraries/Ethernet(3) -c -o '/tmp/compiler.elVKPg/files/Blink'.o '/tmp/compiler.elVKPg/files/Blink'.cpp 2>&1'
sh: -c: line 0: syntax error near unexpected token `('
sh: -c: line 0: `LD_LIBRARY_PATH=/arduino-core-files-OSX/clang/v3_5/lib:$LD_LIBRARY_PATH /usr/bin/clang --target=msp430 -w -fsyntax-only -fcolor-diagnostics  -I/arduino-core-files-OSX/v105/hardware/tools/avr/lib/gcc/avr/4.3.2/include -I/arduino-core-files-OSX/v105/hardware/tools/avr/lib/gcc/avr/4.3.2/include-fixed -I/arduino-core-files-OSX/v105/hardware/tools/avr/avr/include  -D__AVR_ATmega328P__ -DARDUINO=105 -DF_CPU=16000000  -I/external_cores/override_cores/arduino/ -I/arduino-core-files-OSX/v105/hardware/arduino/cores/arduino -I/arduino-core-files-OSX/v105/hardware/arduino/variants/standard -I/tmp/compiler.elVKPg/libraries/Ethernet(3) -c -o '/tmp/compiler.elVKPg/files/Blink'.o '/tmp/compiler.elVKPg/files/Blink'.cpp 2>&1'

Notice the -I/tmp/compiler.elVKPg/libraries/Ethernet(3) part in both avr-g++ and Clang commands.

As a result, both compilers end up with a syntax error, never executing the requested command.

We do redirect stderr to stdout using 2>&1 in the end of all commands provided to PHP's exec, however this doesn't work for such cases.

Need to find a way to catch this output.

Create new install script for Arduino 1.6.0

Create/update a bash script that can be run to install the new compiler software for Arduino 1.6 on an Ubuntu server. This includes downloading dependencies and Arduino core files and building the appropriate subset if necessary. May also include writing a custom build script for Arduino to only include files necessary for compilation, without the GUI.

[Insight] PHP code should follow PSR-1 basic coding standard - in Symfony/src/…/Handler/UtilityHandler.php, line 109

in Symfony/src/Codebender/CompilerBundle/Handler/UtilityHandler.php, line 109

Method names should be declared in camelCase. You should rename this class to comply with PSR-1.

     *
     * \param string $directory The directory to search for files.
     * \param mixed $extensions An array of strings, the extensions to look for.
     * \return A list of files that have the appropriate extension.
     */
    function get_files_by_extension($directory, $extensions)
    {
        if (is_string($extensions))
            $extensions = array($extensions);

        $files = array();

---

Posted from SensioLabsInsight

General Documentation

This is probably a stupid question, but how do you make a successful request to the compiler? I'm having difficulty understanding what data the server actually wants to receive and there are no tutorials explaining how this works. I've been using xmlhttp to post the sketch to the server, but I only get fail messages despite the fact that I'm only using a simple ' void setup(){} void loop(){} ' script.

Thanks in advance!

Make the compiler compile Arduino 1.6 sketches

Start implementing the storing of the files in a temp folder, like it's done now in the CompilerHanlder,
and make sure that the temp folder can be used in order to successfully compile the project with Arduino 1.6 through command line.

Make sure that the response is the same as the one from CompilerHandler's main function (in terms of structure).

Try to keep your code tested (at least functional tests).