mbilling / pbiconnectors

The Microsoft Power BI custom connector support-project

Microsoft Power BI Custom Data Connectors

The Microsoft Power BI custom connector support-project. Thank you for the support from users all over giving me feedback and using the connectors. Users I know of: Francisco Altamirano, Blastam, Masai, Puori, Bangerhead, Columban Mission, Stanton Fisher and Tanger Outlet

Available custom data connectors

• Stripe
• LinkedIn
• Facebook Pages Insight
• Facebook Ads Insight
• Instagram

Any wishes?

I would like feedback on which data connector YOU need. Maybe I can help or we can build it together.

Download ready-to-use packages

You can download ready-to-use .mez files from SCITYLANA here.

The Stripe Connector

This connector should be used instead of the broken official connector.

Here is a list of features that have been fixed:

• Limited access API keys (the original connector only works with the master API key, which is REALLY bad when you want to publish a dashboard)
• Fetching all rows data for all tables (the original connector doesn't handle paging correct)

The LinkedIn Connector

To build the connector you need to create a Linked In App to get an OAuth2 key and secret. Create a the app here

In LinkedIn\WebApp.json set Client Id and Client Secret

      "client_id": "[Client ID]",
      "client_secret": "[Client Secret]",

The connector is an interface to historical endpoints of linkedin Manage Company Pages endpoints

• Get historical follower statistics about a company
• Get historical status update statistics about a company

Focus is on the granular endpoints since they can be aggregated which play well with Power BI. We would prefer the raw hit-level data behind each aggregated date but that is not available through the LinkedIn API

This is how it looks in Power BI:

The Facebook Pages Insight Connector

To build the connector you need to create a Facebook App to get an OAuth2 key and secret. Create a the app here

In FacebookPages\WebApp.json set Client Id and Client Secret

      "client_id": "[App ID]",
      "client_secret": "[App Secret]",

This connector is focused on accessing page insights using the pages insights API: Facebook Pages Insights

The built-in Facebook connector provides access to Facebook user profile, not pages or ads statistics.

This is how it looks in Power BI:

The Facebook Ads Insight Connector

To build the connector you need to create a Facebook App to get an OAuth2 key and secret. Create a the app here

In FacebookAds\WebApp.json set Client Id and Client Secret

      "client_id": "[App ID]",
      "client_secret": "[App Secret]",

This connector is focused on accessing page insights using the ads insights API: Facebook Ads Insights

The built-in Facebook connector provides access to Facebook user profile, not pages or ads statistics.

This is how it looks in Power BI:

The Instagram Connector

Instagram - Facebok page association issue

To pull statistics from Instagram you need to set-up an association with a Facebook Page. This is not a big deal. But if you already did this a while ago, you might need doing it again. If the Instagram connector fails with the message "The field 'connected_instagram_account' of the record wasn't found." then the Instagram account and the Facebook page are not completely connected.

I have been able to circumvent this problem by

1. Switching the IOS/Android app from Business Account to Personal Account and back to Business Account.
2. The again from the IOS/Android app - Unlink Facebook account and Link it again.

Get started

To build the connector you need to create a Facebook/Instagram App to get an OAuth2 key and secret. You need to have your Instagram Account conected to your Facebook Page, read more here

Create a the app here

In Instagram\WebApp.json set Client Id and Client Secret

      "client_id": "[App ID]",
      "client_secret": "[App Secret]",

This connector is focused on accessing page insights using the Instagram insights API: Instagram Insights

This is how it looks in Power BI:

How to use the custom connectors

Microsoft only supports custom connectors for Power BI Desktop. We expect this to change when they release the Power Query SDK.

Using the connectors

1. When custom connectors are built into .mez files, they should be copied to Documents\Microsoft Power BI Desktop\Custom Connectors
2. Start Power BI
3. Ooen the Options dialog
4. Select Preview features and Click OK
5. Click Get Data and select Other
6. You find the Connectors here.

Related repos

Facebook Ads Connector

Youtube Connector

pbiconnectors's Issues

Could you please add link data into facebook ads connector?

It would be great to get for facebook ads infomation regarding target url:

1. "url parameters" value. example value "utm_source=fb&utm_medium=carousel_v2&utm_campaign=get_course_spring&utm_term=main_keyword&utm_content=girl_in_spring"
2. website url. example value: "http://medium.com/"

We discussed on scitylana chat that it is possible to add such a data. Thanks in advance
Here are my contacts for any additional questions: [email protected]

Dmytro Chashnyk

Instagram connector is returning only zeros.

The Instagram connector returns no data for any of the columns (every row has a zero value for every column). In your instructions it seems that your data is also only zeros (although it could be that the demo account did not have any posts).

The image below shows that the entire impressions column has only zero items. The same is true for every other column.

Upgrade PBIConnectors

Hello!
First of all I need to thank you for your connectors!

Can you upgrade them ?
/Instagram/ Facebook

Yesterday I got the following message in Power Bi:
Web.Contents failed to get contents from 'https://graph.facebook.com/v6.0

I downloaded .mez file from here - https://www.scitylana.com/connectors/

Thank you!

data of user, like age, gender and location at Facebook Ads

In my project, i needed to get all type of data from user, but actually there is not.

url blocked

Hello,
I'm new to Power bi. Your connector seems great to me, it is an incredible solution, but I still can not get the facebook page to work, and neither does facebook ads.

The following message appears:
blocked url: an error occurred in the address because the URI is not included in the whitelist of the Oauth client configuration of the application. Verify that Oauth client access and Oauth web access are enabled, and add all domains in the application, such as valid Oauth redirect URIs.
(attached image)

Please, if it was not too much trouble, could you tell me in screenshots how should I make the connection? What should I configure exactly?
I would like to test your connectors.
I tried watching youtube tutorials but none of them managed to help me. :(

Thank you very much for your help

Another app for Facebook Ads connector

Dear Developers, i noticed that your Facebook Ads connector uses your app ID and app secret.
I would like to change it to my own app, just in case yours stops working.

I created an app on Facebook, added "Facebook Login" and "Marketing API" products there.
In the "Facebook Login" settings, i added https://oauth.powerbi.com/views/oauthredirect.html to "Valid OAuth Redirect URIs".

But when i try to sign in in Power BI using my modified connector (with updated client ID and client secret), Facebook shows an error:
"URL blocked: This redirect failed because the redirect URI is not white-listed in the app's client OAuth settings. Make sure that the client and web OAuth logins are on and add all your app domains as valid OAuth redirect URIs."

Do you have an idea what could be wrong?..

Facebook Page - Expression.Error We couldn't find the file 'WebApp.json'

It's in the same folder, but I do get an error on this portion: "Extension.Contents" Any idea how to fix it?

full error: [Expression.Error] We couldn't find the file 'WebApp.json'

Linkedin Connector

Hi, how can I use this json file for getting linkedin data

null values in Facebook Ads connector

Dear developers, i have an issue trying out your Facebook Ads data connector:
when i select my Ad account and select "Facebok All Ad Insights",i get empty rows instead of campaign data (screenshot in my Dropbox).
The number of empty rows does not match the number of campaigns in Facebook.

Any ideas, why it could be?
The campaigns are very old, made in 2014. Could that be the reason?..

connection issues

as of a few days ago - after the connector has worked fine im getting the below error can ayone assist

DataSource.Error: Web.Contents failed to get contents from

Power BI Rest API gives 403 Error

Am trying to call a Power BI Rest API in a custom connector.
The Rest API is registered in the Azure Active Directory and all the delegated permissions are given.
The App registration was done through the below link. The account used to register does have a power bi pro license and have access to the the Power BI datasets.
Attached are the screenshots of the configuration inside the custom connector.

I am able to get the response in Postman after manually retrieving the token using powershell by logging into my account

Error fetching data Facebook Ads

First and foremost i am very thankful for the project.

I'm trying to implement the connector. Since my app graph Facebook API is on v10, I've already changed this inside the project code and I do get response of the endpoint (as I can see the tables after connecting). The problem is an error ocurred as you can see in the image below:

The translation of the message is "We cannot convert 'null' into text type" (I am sorry but me PBI is in portuguese language)

So I think there is a problem setting types for some element of the table. I've tried to detect something that could be different but I was not successful.

Could anyone helpe me? Thanks!

Application access error from Facebook Ads Connector

"Sorry, the app you're trying to use doesn't exist or has been disabled."

Error using LinkedIn connector "The redirect_uri does not match the registered value"

When trying to use the LinkedIn Connector (after building it with the App credentails) we are getting the following error from LinkedIn: "The redirect_uri does not match the registered value".

If I put in the redirect uri in de LinkedIn App the error changes to "error: unauthorized_scope_error
error_description: Scope "rw_organization_admin" is not authorized for your application"

Can't sign in as different user in the Facebook Ads connector

Dear developers, i have another issue trying out your Facebook Ads data connector:
once i signed in with one Facebook account, i can't change it.

In the "Connect" window which writes"You are currently signed in",
when i click the button "Sign in as different user", it writes "You are being signed in" for a moment
and then "You are currently signed in" again.

In Data source settings -> Global permissions i deleted the "FacebookAds" permission.
Then the "Connect" window writes "You aren't signed in",
but once i click on "Sign in", i'm immediately signed in to the same account again.

Please advice!

Facebooks Ads does not load any table

Hi! I get this two errors
first when i try to load into power bi

and second when im trying to compile it

I already change the client id and client secret and also update the authorize uri to https://www.facebook.com/v6.0/dialog/oauth

Help please!!

Facebook oAuth Dialog window does not close

I am currently experiencing the issue that the facebook dialog window does not close after trying to confirm. Therefore during testing I do not see any access token returning.

I have tried this with multiple application IDs, FB api versions and always experience the same behaviour.

Any suggestions?

Multiple Instagram Accounts

First, Thank you for this project, really helped me a lot. Thank you.

I have multiple Instagram accounts, I connected to one and it worked perfectly.

Is there a way to connect multiple Instagram accounts with your connector?

Snapchat Connector

Are there any plans to create a connector for Snapchat Ads? Would be very useful.

Error on Schedule refresh

Hi,

When I try to configure the automatic Schedule refresh in the WEB version of PowerBI I get the following errors:

You can not schedule the update for this dataset because the following data sources currently do not support the update:
Data source for "Facebook Active Ad Action Values"
Data source for "Facebook Active Ad Actions"
Data source for "Facebook Active Ad Insights"
Data source for "Facebook Ad Action Values"
Data source for "Facebook Ad Actions"
Data source for "Facebook All Ad Insights"
Data source for "Facebook All Ad Insights (2)"
Data source for "Facebook Ad Action Values (2)"
Data source for "Facebook Active Ad Actions (2)"

Query contains unknown function name: Facebook AdsAds

Can someone help me?

Thank you

spend data is erroneously separated and does not have a default

the spend data on Facebook Ads Connector is wrong because for example, the real value is $ 4.50 and comes as $ 450, even if we divide it by 100, there will be other numbers where that division can not be made (number in the same case that should be split for 10, for example) and so the value stays wrong. Therefore, the other metrics (CPC, CPM) are calculated incorrectly because they all depend on the spend value for the calculation.

Linkedin connector: redirect URL error

Hi there,

Could it be that this is still using v1? Getting errors on load (access forbidden and v1 in query)

Please HELP! connected_instagram_account not connect...

I have created the app on developers.facebook.com and when starting powerbi all the facebook pages are displayed but when choosing one that I have linked instagram-facebook the tables are not loaded because this error appears:

The 'connected_instagram_account' field of the record was not found.

what's going on? how can I solve it? many thanks!!!

Instagram Connector - Can't connect

--resolved

Facebook Ads: Refresh in PowerBI Web not working

Hi,

apologies if this is a silly question, I'm quite new to PowerBI!

I'm using the pre-built connector from your web site. The refresh works fine from PowerBI Desktop, but doesn't work from the PowerBI website.

The error message is:
Data source errorUnable to refresh the model (id=310773) because it references an unsupported data source.

In the refresh scheduler it says:
You can't schedule refresh for this dataset because the following data sources currently don't support refresh:
Data source for Query1

Could it be an authentication issue or does the data source need to be renamed?

Thank you!

Update LinkedIn Connector to support v2 of API

Hi,
Thank you for creating these connectors, they have been invaluable to me. Recently the LinkedIn connector has stopped working. I'm getting a (410):Gone error message (screenshot attached) and I'm wondering if it's because this is using v1 of the API, which is no longer supported? Can you update this to use v2 please?

Expose actions and action_values for Facebook Ads?

Hi -
First of all, this is great work! I think lots of people are going to get some good use out of it.

I've spent the day trying to modify your code to expose the "actions" and "action_values" fields on the "insights" edge of the Facebook Marketing API.
(I use Facebooks "Offline Conversions" tool, and those results are stored in actions/action_values)

The trouble I'm having is that those fields return a list (or an array? in any case, not a single value) that doesn't play nice with the navigation steps you have happening after the main request loop. If I comment out those navigation steps, and just return the "list" variable, things look all right for a second, but then the query throws a "400: Bad Request" error if I try to filter on any of the expanded action_values items.

A github user named Hugoberry has a repository with a simpler Facebook Ads connector that just spits out a JSON - which works better (insofar as it tries to do less) with the actions and action_values responses. But his script can't handle big requests because it doesn't have the pagination handling that yours does.

Unfortunately, I don't know enough M to tinker with the main list.combine/list.accumulate step that you use to handle big requests, so I haven't come up with a way to combine the two approaches.

Long story short, if this is still a project in active development, I think it'd be really cool if you could add the functionality needed to expose "actions" and "action_values" in the Facebook Ads Insights connector.

Or, if you've got any hints for me, I can keep working toward it as well, and I can share my code with you/other users.

Thanks,
Andrew

error in Facebook Ads template

Dear developers, i have an issue trying out your Facebook Ads template:
when i open the Power BI file, i get an error "Expression.Error: The import Facebook Ads.Ads matches no exports. Did you miss a module reference?"
(screenshot in my Dropbox).

Any ideas, why it could be?

Power BI Rest API gives 401 Error

Hi,

I am trying to get the LOGs from the Power BI Tenant using an Function APP with Python code in it.

When I try to execute the code gives me "401 Error" specifically when I try to obtein the Gateways and Datasources data.

api_url = https://api.powerbi.com/v1.0/myorg/gateways
api_url = https://docs.microsoft.com/en-us/rest/api/power-bi/datasets/get-datasources

The same code Works just fine to "Refreshebles" and "Capacitys" data, for example.

Here a piece of the code

--================================================================
def get_capacities(token):

startday = datetime.date.today() - datetime.timedelta(days=1) #automatic mode startday 

# first call
api_url = 'https://api.powerbi.com/v1.0/myorg/admin/capacities'
json_payload = call_power_bi_rest(api_url, token)
holder_array = json_payload['value']
logging.info(f" first load elements {len(json_payload['value'])}")

str_payload = json.dumps(holder_array)
(After that I save in a Storage Account)

--================================================================

My Tenant administrator tried to give those permissions to the Function APP in Active Directory:
Group.Read.All, Directory.Read.All in the Gateways and Datasets configurations.

Do you guys have any idea if this permission is enough? Or do the Function APP need to have permission of Write to?
Group.Read.All, Group.ReadWrite.All, Directory.Read.All and Directory.ReadWrite.All.

Any help will be much appreciated!

Instragram Follower count

Hi Michael!

First of all thanks for building and providing access for these connectors.

I am using Instagram connector and I could not understand how follower_count is working. I was getting new followers throughout the day but not all of them were shown in statistics. Would be very grateful if you can support in this question.

Thanks!

Best regards,
Alexander

A few more columns please!

I am using the connector to create the full funnel from impression to behaviour on site. To evaluate ROAS through Facebooks own attribution as well as the attribution model used in Google Analytics (Scitylana raw data), it would be necessary to have the following columns added in the connector:

• website conversions
• website conversion value
  Thanks!

API Throttling

I'm getting blocked by the facebook api (needed to upgrade to v5) because of rate limits. Any solution for this? Currently trying to add some delays with Function.InvokeAfter.
https://developers.facebook.com/docs/marketing-api/insights/best-practices/

Cannot Login with Facebook with Instagram connector

Thank you Michael for letting the community the possibility of use your connector for powerBI.
Anyway I've got a problem with the instagram connector. I've registered a facebook developer app and edited the json file with the app id and secret, but when I try to connect (with organizational account) the pop up window gets stuck on a blank facebook page ("https://www.facebook.com/v2.12/dialog/oauth

Facebook API v7 FIX

If you have any problem with the new version of the facebook API just make this update to the file FacebookPages.pq

Line 13:

> scopes = {
> 	"read_insights", "pages_manage_ads", "pages_manage_metadata", "pages_read_engagement", "pages_read_user_content", "pages_manage_posts", "pages_manage_engagement"
> };

And that's it, your're ready to go.

Scheduled refresh not working for FacebookAds

Hi. I'm getting the following error when trying to schedule a automatic refresh using the Facebook.Ads connector.

You can't schedule refresh for this dataset because the following data sources currently don't support refresh:
Data source for "Facebook All Ad Insights"
Discover Data Sources
Query contains unknown function name: FacebookAds.Ads

Refreshing the data works inside of PowerBI Desktop, but not when published.

I'm getting the following error too:

Any ideas?

I downloaded the connector from https://www.scitylana.com/connectors, not building from scratch.

Facebook Ads does not load ad accounts in navigator

I don't see any ad accounts when trying to connect to the data source. When in Facebook adsmanager I see at least 2 personal and one business account. Have I misunderstood any concepts here or could you guide me to any relevant tests I should run?

Thanks.

Update:
When running the https://graph.facebook.com/v6.0/me/adaccounts call using Postman, I do see the three accounts. At least one of them returns data on /ads.

Custom connector teamleader crm

Hello,
We are storting to create a custom connector for teamleader crm but can't get it to work..
Here you can find the docs https://developer.teamleader.eu/#/reference/crm/contacts/contacts.list

We are testing to modify this script but always get a http 400 error.
https://github.com/jussiroine/OuraCloudConnector

Any ideas on how to make this work or even do better?

Facebookads connector

There are some issues now with the fcb connector, it won't get data.

Facebook/Instagram credentials in Power BI service

Hi @mbilling

This project is brilliant in its simplicity, and I'm impressed at how well the connectors work in Power BI Desktop. On the other hand, I have not yet had luck getting the connectors to work in the Power BI Service via the On-premises gateway (personal mode).

I have added the custom connector to my gateway, and it appears to be recognised when looking at the data source setup in the Service. However, when attempting to configure the connector (set up credentials), the OAuth window appears to open and immediately close. No error message of any kind, but also no authentication screen nor any credentials being saved. The behaviour is exactly the same between the Facebook and Instagram connectors.

Have you by any chance experienced this before, and/or do you have any guidance on getting the connectors to work in the Service? Thus far I've been using the ready-made connectors from SCITYLANA, but I am of course also willing to try setting up my own client if needed.

Thanks for your great work!