Data Science Stack Exchange
Data Science Stack Exchange

Questions tagged [google-bigquery]

BigQuery is Google Cloud's fully managed, petabyte-scale, and cost-effective analytics data warehouse that allows to run analytics over vast amounts of data in near real time

8 questions
1
vote
1 answer

Is it possible to update data and retrain just one of several data series in bigquery model

I am building something very similar to this BigQuery ML example project. My system is different in two ways: Firstly it will need several thousand time-series so I would prefer to use the multiple-series feature rather than having thousands of…
scipilot
  • 121
  • 3
1
vote
0 answers

Recommendation Systems User Profile Streaming Data on GCP

I have a recommendation system that recommends articles to different users. I am planning to provide the recommendations in an off-line fashion. Where I already have a table in BigQuery which has the recommendations and an API call returns the…
m2rik
  • 321
  • 2
  • 11
1
vote
0 answers

Help with BQ table

I am trying to build a partition table populated with data from shareded tables. So, in this partition table, I'll unnest some variables, in order to have the data more organized. My question is: in order to have the table populated with all the…
PTaq
  • 11
  • 1
1
vote
0 answers

Query google trend using google BigQuery

I need help with google BigQuery. Am using big query to query data from Google Trends. now I want to get data using a specific keyword example spiderman, and get the result in regions like CSV downloaded in google trend "interest over time". But…
Alvin masievi
  • 11
  • 1
0
votes
1 answer

Transitioning from a python script for data transformation to BigQuery

So I have a dataset spread over multiple and ever-growing excel files all of which looks…
Hamza
  • 143
  • 4
0
votes
0 answers

How to schedule importing data files from SFTP server located on compute engine instance into BigQuery?

What I want to achieve: Transfer hourly coming data files onto a SFTP file server located on a compute engine VM from several different feeds into Bigquery with real-time updates effectively & cost-efficiently. Context: The software I am trying to…
Hamza
  • 143
  • 4
0
votes
0 answers

Why does Google BigQuery repeat CPC codes and Inventive/Primary attributes in patent data?

I've noticed that data pulled from Google Patents via BigQuery may have duplicate entries for the same values of {publication_number, cpc_code, cpc_inventive, cpc_first}. For example: The key parts of the BigQuery SQL I'm using to retrieve this…
Bob Chatham
  • 1
  • 1
0
votes
1 answer

SQL BigQuery function to return the previous non null value

I have the following table where some of the values are null and I would like to fill them with the previous non-null values. LAG function helps but if there are more than one null value in a row, it does not work. * What other approaches could be…
Nata
  • 3
  • 4