Brands Dashboard – Data Pipeline Documentation¶
1. Links¶
App Scripts:
https://script.google.com/home/projects/1sRl85KMjdF1S2pSlhgKWwusQ5UNnqQLyuClGdffWO9FECnnW_FM5JD2-/edit
BigQuery:
https://console.cloud.google.com/bigquery?project=dubai-basketball-472511
Main Dashboard:
https://lookerstudio.google.com/reporting/845d3a2f-16e9-4d3e-bfb4-254b98c6f121/page/p_emoz16jswd>
Sentiment Dashboard:
https://lookerstudio.google.com/reporting/580e7f58-35ee-4833-895f-00cb79ac5082
2. Extract Layer (App Scripts)¶
Script Name |
Dataset |
Table Name |
Frequency |
Notes |
|---|---|---|---|---|
SERP Data |
test |
dubai_visibility |
Daily |
— |
MENA SERP Data |
test |
dubai_visibility |
Daily |
— |
Publishers Data |
test |
publishers_site_data2 |
Daily |
— |
MENA Pub Data |
test |
publishers_site_data2 |
Daily |
— |
Search Volume |
main |
search-volume |
Monthly |
— |
There are other scrips also in appscript folder, use if required(backfill data to get old dates data)
3. Transform Layer (BigQuery – Scheduled Queries)¶
Query Name |
Dataset |
Table Name |
Frequency |
Notes |
|---|---|---|---|---|
Visibility_LS |
main |
dubai_visibility_ls |
Daily |
— |
Dubai_sentiment |
main |
sentiment tables |
Daily |
— |
bubble_sv_growth |
main |
Playstation_Positions_Master |
Daily |
— |
bubble_sentiment_growth_char |
main |
Playstation_Positions_Master |
Daily |
— |
6. Dashboard Tables¶
Table Name |
Charts |
Dataset |
Notes |
|---|---|---|---|
dubai_visibility_ls |
2+2 |
master |
Replaced old tables |
publishers_sentiment_analysis2 |
4 |
search_volumes |
Monthly |
dubai_sentiment_analysis |
1 |
master |
— |
bubble_growth_sentiment_analysis |
6 |
master |
— |
reddit_basketball_posts |
2 |
master |
Weekly |
7. Filters (Looker Studio)¶
Filter Name |
Table |
Description |
|---|---|---|
rm_classiclink |
Customer_Numbers_Check |
|
Exclude |
||
SERPFeature |
||
Equal to (=) |
||
classicLink |
||
Playstation Sites Only |
Customer_Numbers_Check |
Site Contains playstation.com |
Playstation Sites Only (Positions) |
Playstation_Positions_Master |
Include playstation.com |
Competitors Only |
Customer_Numbers_Check |
Exclude Playstation |
Many more as required |
— |
— |
8. Triggers¶
Competitor Triggers¶
Dataset |
Table |
Time IST |
|---|---|---|
test |
mainPAA |
10 |
test |
mainPosPublishers |
10 |
test |
mainVisMENA |
9 |
9. Notes¶
• If you have 101 data for all positions and if daily API date check shows tracking not done for yesterday then visit BreakFix tab
• Additional notes