Comments (6)
Hi @amirali-shfz I have good news!
I spent my evening on it and realized that it is actually still possible to create a bookmarklet.
(Unlike what I thought TrustedScriptURL stuff does not prevent to load external scripts, we just need to declare them safe).
I will modify the documentation of explore_column function to show you how to use it.
(there still are some adjusments to do but I'd be glad to check it works on your side already).
I'll let you know when the documentation is updated
from bigfunctions.
- I am new to dealing with data directly, and currently dealing with some very unclean tables. It'd allow me to understand a column quickly without doing multiple queries to check fill-rate, seeing some samples, etc. Honestly I'm likely butchering this function by calling it on a string column... Looking at dataplex, it seems to answer this issue actually nice pointer! I'll look into that.
- It would be fine if there was a link that I could click and see the graph elsewhere. Note that this is in work context and I'd have to ensure the security of my actions are aligned with company policy.
- Likely not for a work place use-case. I'd much rather get an html I could render myself
(btw awesome project I'll have to say)
from bigfunctions.
Hi @amirali-shfz.
I am very pleased you created this issue.
When I started bigfunctions more than a year ago I designed a bookmarlet (kind of chrome extension but easier) to render the html result of a function in BigQuery console such as this screenshot.
But:
- BigQuery UI changed, then the bookmarklet did not work any more
- Google released dataplex data profiling and then I was not sure that this function is still needed anymore.
- More importantly, I came to think that functions should not create html, only data. If we want to render data in a UI we should use another tool.
So I gave up html rendering in BigQuery console.
Until now.
I'd be please to have your feedback:
- Is this function really interesting to you? Why not use dataplex data profiling?
- Would you use if it were accessible not from bigquery console but from another website such as https://cloud.unytics.io ?
- Would you be ready to authenticate with google on that website so that it can use your BigQuery credentials to perform the query for you before displaying the rendered html?
from bigfunctions.
Thanks @amirali-shfz for your answers. Very insightful.
A. It seems not possible to render html with charts in BigQuery console anymore
I tried to make my bookmarlet work again, but it seems that Google secured its page and I am not able to load external javascript anymore (I get the error "This document requires 'TrustedScriptURL' assignment."). Thus I am not able to load chart.js for charting any more.
B. Sending to cloud.unyics.io the result of the function
I understand that exposing your BigQuery credentials to cloud.unytics.io so that cloud.unytics.io make the queries for you is not safe enough for a work place. But sending the computed statistics in json to cloud.unytics.io is much preferable as you would have more control on what you send to cloud.unytics.io. Correct?
So one way to handle this would be:
- Run
call compute_table_statistics('project.dataset.table')
- Run
call send_bigfuntion_result_to_unytics()
. - This remote function then stores the json + the fact that it is owned by your email in a unytics database.
- You can then go to cloud.unytics.io, sign in with Google Sign In (cloud.unytics.io only sees your email) and then you can see the rendered html. You can also delete the json from here.
What do you think? Would it be ok for you?
from bigfunctions.
Hi @amirali-shfz. It works!
The documentation is displayed on each function.
For example here for explore_column
Let me know if it works for you and I'll close this issue.
from bigfunctions.
This works for me! This is awesome man! Thanks for fixing this up, super cool project.
from bigfunctions.
Related Issues (20)
- [new]: `copy_table(table_src, table_dest)` HOT 3
- [bug]: `exchange_rate`: it does not work HOT 3
- [bug]: ask_ai deployment has problems and few debug hints HOT 2
- pandas_corr(FULL_TABLE_ID STRING)
- [bug]: `bigfunctions.eu.translate`: it does not work HOT 3
- [new]: `refresh_tableau(obj_title_to_refresh)` HOT 2
- [bug]: `send_email`: it does not work - Authenticated user is not authorized to send mail HOT 2
- [new]: `udaf` compatibility - `weighted_average`(element, weight)
- [bug]: `is_email_valid`: Wrong for glow.sch.uk domain HOT 1
- [bug]: `faker`: latlng & local_latlng - BigQuery JSON decode error HOT 3
- [bug]: prophet: Does not work as expected.
- [feature]: Add an option to pass the config file
- [bug]: `exchange_rate`: it does not work for `GBP` to `USD` HOT 1
- [bug]: `faker`: Many functions (random_int, boolean...) does not work in BigQuery HOT 1
- [new]: `array_z_scores(arr)` HOT 1
- [improve]: `create_materialized_view_w_flattened_json_column`: column duplication management
- [improve]: `sleep`: fully in BigQuery SQL (to save cloud run / python costs) HOT 3
- [new]: `refresh_powerbi(dataset_id, workspace_id, tenant_id, client_id, client_secret_encrypted)` HOT 2
- [new]: `list_bucket_files( bucket_url [, encrypted_token] )` HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from bigfunctions.