smile-gator / data-analytics

Data Analytics Accelerator Repository

Welcome to the Data Analytics repository. This repository contains the latest examples to get you started with application optimization targeting Xilinx PCIe FPGA acceleration boards. All examples are ready to be compiled and executed on boards hosted in the Amazon F1 clouds. The repository information is provided as below

1. BIG DATA ACCELERATION
2. ACCELERATION MODULES
3. DIRECTORY STRUCTURE
4. OTHER INFORMATION
5. SUPPORT
6. REVISION HISTORY

1. BIG DATA ACCELERATION

This repository provides source code for big data acceleration on FPGA. In particular, this provides acceleration kernel for PostgreSQL RDBMS and Text files. The acceleration is in SQL Query and other typical big data operations.

2. ACCELERATION MODULES

This repository includes the following acceleration modules that can be run on F1

xpg

It accelerates Postgres query by offloading scanning operations to Xilinx FPGA. The query plan is intercepted during the execution, and data is streamed to the FPGA for scan acceleration. The output relation is then registered with postgres database. The FPGA kernel parses native Postgres storage blocks in a massively parallel implementation of SQL Engines.

Please run the tutorial on F1 by following the tutorial directions F1-XPG-TUTORIAL.md

xql6

It accelerates Query 6 integrated within Postgres as a UDF (User Defined Functions). It sends Postgres tables to FPGA. An array of Query 6 processors process this native data to produce Query 6 results. When comparing end-to-end solution on F1, it shows 2.8x better performance. Kernel level performance is an order of magnitude better than F1 CPU.

Please run the tutorial on F1 by following the tutorial directions F1-XQL6-TUTORIAL.md

Refer to xql6/README.md to learn more about this acceleration.

xsql61

It shows an accelerated TCPH Query 6 and 1 implementation on text tables.

Please run the tutorial on F1 by following the tutorial directions F1-XSQL61-TUTORIAL.md

Refer to xsql61/README.md more information.

3. DIRECTORY STRUCTURE

All the latest files in the directories are present in Xilinx github at https://github.com/Xilinx/data-analytics

Each directory contains a makefile to build host code, library and Xilinx Kernel for target platforms. These are the directories and their functionalities.

Directory	Description
xpg	Postgres integrated TPCH Query Acceleration host code
xsql6	Postgres integrated TPCH Query 6 Acceleration
xsql61	Host code and Xilinx FPGA Kernel code to run Query 6 and Query 1 on FPGA
xdbconn	An API structure to move blocks of data from host to device using Xilinx SDx
xsqlutils	Sql library with functions to handle Sql data on FPGA

4. OTHER INFORMATION

For more information check here: SDAccel User Guides

5. SUPPORT

For questions and to get help on this project or your own projects, visit the [SDAccel Forums][].

6. REVISION HISTORY

Date	Readme Version	Revision Description
OCT2017	1.0	Initial Xilinx release