quadratichq / quadratic Goto Github PK

Quadratic | Data Science Spreadsheet with Python & SQL

License: Other

JavaScript 2.47% HTML 0.46% CSS 0.28% TypeScript 48.75% Python 1.56% Rust 45.95% SCSS 0.06% Procfile 0.01% Shell 0.35% Dockerfile 0.05% PLpgSQL 0.07%

python data-science spreadsheet sql quadratic etl data-engineering data-analysis data wasm

quadratic's Introduction

quadratic's People

Contributors

Stargazers

Watchers

Forkers

bartbroere entercloud davidfig shabbirhasan1 skiderdun boaarmpit ltyl wolewnicki kieranholroyd 0x00evil shenchuanhuan hanswestman74 swaptr suryatmodulus dangan114 djd0723 deshumake sten2lu gg-big-org hardik-satasiya briannewsom icodein dk8996 stlbucket peterwangsc eightys3v3n cyoab real-currents ronpastore koekebakkerzh irjensen dhruvinshiroya angleton hotelzululima himself65 abstractalgo hbcbh1999 tshauck sergioisidoro stvhanna anhgeeky datadevopscloud laquereric spread0x sandilya28 datduyng chorylee erson rosperitus dolfp99 droidcraft ippsav nukacody probablyrelevant gilshoshan94 devshekhawat zhangtong102778 lizonghan1107 wangyamei0922 zhuyuchen0227 liguangjie0423 sunyiming0425 zhangbeibei0902 wanglei122982 zhangdi12202023 niumengmeng1215 tangyan120683 chensu0329 wangkai081882 notmybad hhy5277 somombo sueheir linecode nerptastic nithinps021 juanbercoff jmptrader samjberry ajboots aradhyavivan esenbe africain automationkit fstfwd mdr0id taquanminhlong jquesada2016 jadegeek sanyaade-projects meehawk demonisius kaif-gh lokeshjonnakuti ego dimitrianoudi mz0in prakhar-srivastava em3ndez jan186

quadratic's Issues

Feature Request: Application Specific right-click context menu

The current spreadsheet does not support right click context menu options specific to the application. It'd be great to have the standard spreadsheet options available through the context menu.

Current menu:

Standard spreadsheet context menu:

Bug - Open other cell when editor is open

Double-clicking works, but "=" and "enter" do not.

Grid axis do not render on some platforms

On Chrome and Apple M1 grid axis do not render unless zoomed all the way out.

Clicking top left corner selects all and Zooms to Fit

On cell update `array_cells` is not always properly cleared.

Load Example on First Time Opening

Cell Placeholder "Press `\` to code"

Demos

Create a way to load and save files (to json, simple)
Create a few examples to be able to demo

Bug - df does not return column headers

Bug: DF with undefined column will not expand

Improve Quadratic Cell API in Python

getCell()
getCells()
c()

Come up with easier to use functions to get quadratic data
Get as pandas data frame
Remove necessity to add await (very confusing for typical python users)
Return cells in a native type that is easier to work with and more beginner friendly
Includes making cell type work for default operations like adding.

Cell Interaction: Notes

Using this issue to keep track of common interaction issues:

When moving back to a python cell, it should save your scroll position.
Command + Enter should not close the editor
Better indicator of cells that contain code

⇧+`/` or ⌘+`/` to show an in-sheet help menu

while perusing http://early.quadratic.to I often forgot what I could do and would like to be able to bring up a help menu or search menu of all actions I could take that aren't just specific to cell operations (like / is used for). e.g. share, export, duplicate, archive the grid etc

SQL Grid Support

https://github.com/duckdb/duckdb-wasm

get running
Pull data in from the grid as a table
Return data to grid as result

Electron - Window can not be moved when loading.

Integrating Python requests

As discussed before with @davidkircos , it would be cool if requests could be integrated in Quadratic.

This in turn could enable all kinds of cool use cases, like loading CSV from an URL.

import pandas
from io import StringIO
import requests

pandas.read_csv(StringIO(requests.get('https://gist.githubusercontent.com/netj/8836201/raw/6f9306ad21398ea43cba4f7d537619d0e07d5ae3/iris.csv').text))

My current progress of shimming requests is tracked here bartbroere/requests#1 and here: https://github.com/NetherlandsForensicInstitute/pyodide/blob/0.19.0/packages/requests/meta.yaml

It is integrated in custom Pyodide builds by patching the original requests package. I would be happy to help and get this to work.

Can't render cjk using bitmapText

Self Host Pyodide for Consistency

Currently linked via https://cdn.jsdelivr.net

Move to self hosted

https://sentry.io/organizations/quadratic/issues/3337040633/?alert_rule_id=10862959&alert_timestamp=1654786338641&alert_type=email&environment=production&project=6333132&referrer=alert_email

Cell Formatting

Code Editor Should be Resizable

Cleanup Before Release

Undo / Redo Functionality

Research Command Pattern & Memento Pattern

Bug Selecting Cells Moving Offscreen

When selecting a range of cells that moves offscreen the view attempts to jump back to the cursor.

STD out does not update after run

When a Python cell is open, double clicking another cell should move the editor.

Copy Paste Error

Bug

What is the issue?

Copy pasting a group of cells results in error page

How to reproduce the issue?

Copy paste any cells that contains the table data and paste it in an empty location.

What are the environment details?

OS: macOS Monetery 12.0.1
System: Macbook M1 Pro 2021
node version: 10.15.1
npm version: 7.24.2
browser: Firefox 99.0.1

Screenshots

QuadraticDependencyGraph Usage Bugs

The dependency graph usage has many bugs.

Clean up cell loop to not run cells multiple times
Updates to Cell deps does not remove old deps
Deleted Cells are not removed from Dep Tree
Everywhere UpdateCellsDB or DeleteCellsDB are called we need to call actions instead that manage the DGraph as well as updating the DB

Optional -- Probably Move to A Future Task

Tests to verify everything is working properly.
Loops can be created

Include Python Files with a Grid

use pyImport from Pyodide to be able to load a set of files with a grid so they can be imported by name and used in cells

https://pyodide.org/en/stable/usage/loading-custom-python-code.html

Tasks

UI to add Python files
Python files are packed into the .grid
User can import files and use them in cells
Python files can not access the grid directly.

Progress Indicator for Cells While Running Code

Show progress for cells that are running.
If a cell returned an array, show that space as allocated while running. Maybe keep old values as shimmering?
Move Python code execution to a WebWorker (if feasible).

Bug - code editor routinely overrides cell 0,0 will old code

pandas.Series behaviour differs from a pandas.DataFrame

My apologies if this issue was already tracked somewhere else, but when I make a pandas.Series in a cell, it looks different from when I make the same column in a pandas.DataFrame.

Highlight Cells Referenced in Code

When code references cells, highlight those cells and the code in the same color so it's clear what is being referenced.

Python Errors: Stack Trace is Wrong

Line errors are not helpful when they come from other packages. Says a line number that isn’t in your code, without the full stack trace.

Example formula:

import pandas as pd

a = pd.DataFrame()
a[0][0]

Demo App Collaborative Files

Dexie Cloud

You can use your when creating databases using npx dexie-cloud create. Let me know if you need more email addresses added!

Some new docs were added [Dexie Cloud docs](https://dexie.org/cloud/docs/) in recent days. Unless you already have the grip of it, one way to get started with the service is by playing around with the [todo-list sample app](https://github.com/dexie/Dexie.js/tree/master/samples/dexie-cloud-todo-app).

feat: Data Types

Have grid cells format text for common data types: currency, date, number, etc
In Python take cells input and interpret them natively in their Quadratic Cell type. Ex if a user inputs a date, when the cell data arrives in python, it should be a DateTime type.

Resizable Columns

Quadratic columns are currently a fixed width.

To Do list

UI for column header
UI for row header
UI for resizing columns
Backend for storing column widths
Make sure all offsets in the code work properly with columns of varying width (clicking on a cell, drawing cells, etc.)

ReferenceError: WebAssembly is not defined

In browsers where WASM is not supported show a modal asking users to use Chrome.

Sentry Issue: QUADRATIC-4

ReferenceError: WebAssembly is not defined
  at abort (/pyodide/v0.19.0/full/pyodide.asm.js:14:202379)
  at None (/pyodide/v0.19.0/full/pyodide.asm.js:14:191667)
  at loadPyodide (../src/js/pyodide.js:282:9)

Alert on Startup to Use Chrome

Quadratic is only officially supported on Chrome and stable on Firefox. Safari is not well supported.

We should create a welcome message for users of Safari encouraging them to use Chrome.

Cell Select & Multi Select Bug (rewrite)

https://github.com/davidkircos/quadratic/blob/06b4b6e012d7c49c7513dc6bca2d80a5bc3d65e1/src/grid/interaction/interaction.ts#L106-L111

Does not work for selecting a single cell, or selecting cells anywhere in the negative cell space.

Write multi select cursor as ReactPixi element
Write select logic on QuadraticGrid
Rewerite input box
Double click to edit cell
Move input state to atom
Cleanup - Delete old unused logic
Cleanup - File organization
Cleanup - Move Atoms to files

Demo App URL Based Grid Files

Drawing Grid Lines Dynamically

The code that renders grid lines generates a static number of lines, many of which are not visible at any given point.

https://github.com/quadratichq/quadratic/blob/main/src/core/gridGL/graphics/drawGridLines.ts

Rendering grid lines should be dynamic based on the location of the viewport.

Ex grid lines stop being rendered at y = 500

Full Traceback for Python Errors

Traceback is currently limited to the line of code with the error. We should show the full stack trace

Fail CI with Typescript or ESLint Errors/Warnings

Spreadsheet UI Should More Closely Match Excel

The spreadsheet is not numbered clearly. The traditional letter-number system may be better (A1)

The top left negative space is not needed and can be confusing when navigating.

Example Menu in Demo App

Add a Demos menu in the TopBar allowing users to click through a couple of demo sheets.

Windows - Command keys are not mapped correctly.

Control C
Control V
Control + A
Windows with mouse, not easy to pan and zoom.

Database Support

Knex.js for connecting databases

Should work for npm start & electron. No support for "Cloud".

get node+express running alongside app (web + electron)
store database credentials in localstorage
pipe requests through Node, Express API running locally
Database credentatls are added via file bar
Databaes are queried via cells.
Create SQL Editor
Select target database, or grid

Python client for uploading data

Hi there! First of all love your product and the direction it's going. I come from a background of using numpy, pandas, vaex etc on a daily basis and so have learned to be pretty comfortable querying and manipulating data in python. Doing the same operations through google sheets, by comparison, makes me surprisingly frustrated.

I run a lot of ML experiments that output numbers it would be easiest for me to see in a spreadsheet format. Recently I looked into using the google sheets API or python clients (pygsheets and gsheets) and while the onboarding experience was quite terrible (it took so long to figure out authentication) the eventual experience has been quite nice for me. To keep it simple, I generate a pandas dataframe and push it up to a new worksheet I create for that experiment.

That get's me now 80% of the way there because I then just have to apply some styling and copy some additional cells from a template I have and I get a mostly programmatically auto-generated output from my freeform experiments, which I love!

So, is there any ideas of in the future making a python client that makes it very easy to use quadratic as the frontend for ML experiment results or any other data science workflow? A lot of folks use jupyter notebook variants or streamlit, but they don't quite work as well as I think this could.

feat: Formula output should be linked to formula

When selecting the output of a Formula or Python, it should should you the formula that creates it. Or allow you to override starting with a blank cell.

quadratichq / quadratic Goto Github PK

quadratic's Introduction

The infinite multiplayer spreadsheet, with Python, SQL, and AI

Production build

Documentation

Community

What is Quadratic?

What can I do with Quadratic?

Development progress and roadmap

Examples

Quadratic is hiring