oauth2client on GCE throws AttributeError no attribute redirect_uri #342
Description
[Use this form for both apiclient and oauth2client issues]
What steps will reproduce the problem?
1. I am porting an Python 2.7 script to a new GCE
2. The script runs on local laptop and connects to BigQuery perfectly
3. The script throws error when run on GCE instance
What is the expected output? What do you see instead?
When run on local laptop all is good. But, when run on a new GCE which I build
2 hours ago with the latest client API, the script throws the following error
after the client creates the flow:
_HAVE_FLOW: True
TEST _HAVE_FLOW: True
have storage, next use it to retrieve credential from file:
bigquery_credentials.dat
ERROR - credentials is None
Run oauth2 flow with default arguments
- Write_CVS_Records_to_BigQuery() Unexpected error: <type 'exceptions.AttributeError'>
Write_CVS_Records_to_BigQuery() AttributeError: 'NoneType' object has no
attribute 'redirect_uri'
CLOUDSDK_CONFIG: /home/.../.config/gcloud
GOOGLE_APPLICATION_CREDENTIALS:
client_secret_Xkjduoiyewryq3.apps.googleusercontent.com.json
GCLOUD_DATASET_ID: applied-algebra-93003
------------------------------------------------------------
Traceback (most recent call last):
File "/dump/CI_SA_load_bq.py", line 221, in Write_CVS_Records_to_BigQuery
credentials = tools.run_flow(_FLOW, storage, tools.argparser.parse_args([]))
File "/usr/lib/python2.7/site-packages/oauth2client/util.py", line 137, in positional_wrapper
return wrapped(*args, **kwargs)
File "/usr/lib/python2.7/site-packages/oauth2client/tools.py", line 190, in run_flow
flow.redirect_uri = oauth_callback
AttributeError: 'NoneType' object has no attribute 'redirect_uri'
------------------------------------------------------------
Traceback (most recent call last):
File "/dump/CI_SA_load_bq.py", line 266, in <module>
Write_CVS_Records_to_BigQuery()
File "/dump/CI_SA_load_bq.py", line 221, in Write_CVS_Records_to_BigQuery
credentials = tools.run_flow(_FLOW, storage, tools.argparser.parse_args([]))
File "/usr/lib/python2.7/site-packages/oauth2client/util.py", line 137, in positional_wrapper
return wrapped(*args, **kwargs)
File "/usr/lib/python2.7/site-packages/oauth2client/tools.py", line 190, in run_flow
flow.redirect_uri = oauth_callback
AttributeError: 'NoneType' object has no attribute 'redirect_uri'
~]$
What version of the product are you using? On what operating system?
The latest verion installed by pip. The most recent Centos version of GCE
Please provide any additional information below.
More than likely this is a configuration problem on the GCE; I've likely missed
adding some setting required on a GCE instance. Here's the 2 suspect methods
related to the AttributeError:
_SECRET_FILE_NAME='client_secret_devgce2.apps.googleusercontent.com.json'
_REDIRECT_URI='urn:ietf:wg:oauth:2.0:oob'
# Set up flow object to be used for authenticating the client
def Get_Client_Flow():
try:
if os.path.exists(_SECRET_FOLDER_NAME):
print "_SECRET_FOLDER_NAME: %s exists"%(str(_SECRET_FOLDER_NAME))
_SECRET_FILE = os.path.join(_SECRET_FOLDER_NAME,_SECRET_FILE_NAME)
if os.path.isfile(_SECRET_FILE):
print "_SECRET_FILE: %s exists"%(_SECRET_FILE)
_HAVE_SECRET_FILE=True
_FLOW = flow_from_clientsecrets(_SECRET_FILE,
scope='https://www.googleapis.com/auth/bigquery',
redirect_uri=_REDIRECT_URI)
if not _FLOW==None:
_HAVE_FLOW.append(True)
print ("_HAVE_FLOW: %s")%(_HAVE_FLOW[0])
else:
_HAVE_FLOW.append(False)
print ("_HAVE_FLOW: %s")%(_HAVE_FLOW[0])
else:
print "_SECRET_FILE: %s does not exist"%(str(_SECRET_FILE))
else:
print "_SECRET_FOLDER_NAME: %s does not exist"%(str(_SECRET_FOLDER_NAME))
except Exception, inst:
print "\n - Get_Client_Flow() Unexpected error: %s"%(str(sys.exc_info()[0]))
if isinstance(inst,ValueError):
print "Get_Client_Flow() - ValueError: %s\n"%(inst.message)
if isinstance(inst,AttributeError):
print "Get_Client_Flow() - AttributeError: %s\n"%(inst.message)
if isinstance(inst,TypeError):
print "Get_Client_Flow() - TypeError: %s\n"%(inst.message)
#print "\nPYTHONPATH: %s" % (os.environ['PYTHONPATH'])
print "CLOUDSDK_CONFIG: %s" % (os.environ['CLOUDSDK_CONFIG'])
print "GOOGLE_APPLICATION_CREDENTIALS: %s"%(os.environ['GOOGLE_APPLICATION_CREDENTIALS'])
print "GCLOUD_DATASET_ID: %s"%(os.environ['GCLOUD_DATASET_ID'])
print '-'*60
traceback.print_exc(file=sys.stdout)
print '-'*60
raise
def Write_CVS_Records_to_BigQuery():
try:
print "\n Write_CVS_Records_to_BigQuery()"
'''
Connect to BigQuery Service API
'''
Get_Client_Flow()
if _HAVE_FLOW[0]:
print ("TEST _HAVE_FLOW: %s")%(_HAVE_FLOW[0])
#_FLOW.redirect_uri = _REDIRECT_URI
# GET oauth2client STORAGE
storage = Storage('bigquery_credentials.dat')
if storage is None:
print "storage is None, error creating means for retrieving credential from file: %s"%('bigquery_credentials.dat')
else:
print "have storage, next use it to retrieve credential from file: %s"%('bigquery_credentials.dat')
credentials = storage.get()
if credentials is None:
print "ERROR - credentials is None"
if credentials is None or credentials.invalid:
print "Run oauth2 flow with default arguments"
# Run oauth2 flow with default arguments.
credentials = tools.run_flow(_FLOW, storage, tools.argparser.parse_args([]))
# create the HTTP object to handle your requests, and authorize with your credentials
http = httplib2.Http()
http = credentials.authorize(http)
# create the service object for interacting with BigQuery
_BIGQUERY_SERVICE = build('bigquery', 'v2', http=http)
print ("BEGIN call to loadTable()")
try:
#print "did not call loadTable()"
loadTable(_BIGQUERY_SERVICE, _PROJECT_NUMBER, _BIGQUERY_DATASET_ID, _TARGET_TABLE_ID, _SOURCE_CSV)
except HttpError as err:
print 'Write_CVS_Records_to_BigQuery() HttpError:', pprint.pprint(err.resp)
print 'Write_CVS_Records_to_BigQuery()- HttpError content: %s: '%(err.content)
print 'Write_CVS_Records_to_BigQuery() HttpError uri - loadTable(): ', pprint.pprint(err.uri)
except AccessTokenRefreshError:
print ("Write_CVS_Records_to_BigQuery() - Credentials have been revoked or expired, please re-run"
"the application to re-authorize")
else:
print ("TEST _HAVE_FLOW: %s")%(_HAVE_FLOW[0])
except Exception, inst:
print "\n - Write_CVS_Records_to_BigQuery() Unexpected error: %s"%(str(sys.exc_info()[0]))
if isinstance(inst,ValueError):
print "Write_CVS_Records_to_BigQuery() ValueError: %s\n"%(inst.message)
if isinstance(inst,AttributeError):
print "Write_CVS_Records_to_BigQuery() AttributeError: %s\n"%(inst.message)
if isinstance(inst,TypeError):
print "Write_CVS_Records_to_BigQuery()TypeError: %s\n"%(inst.message)
#print "\nPYTHONPATH: %s" % (os.environ['PYTHONPATH'])
print "CLOUDSDK_CONFIG: %s" % (os.environ['CLOUDSDK_CONFIG'])
print "GOOGLE_APPLICATION_CREDENTIALS: %s"%(os.environ['GOOGLE_APPLICATION_CREDENTIALS'])
print "GCLOUD_DATASET_ID: %s"%(os.environ['GCLOUD_DATASET_ID'])
print '-'*60
traceback.print_exc(file=sys.stdout)
print '-'*60
raise
This is not likely, in my view, a bug with the API, but a matter of an omitted setting in the code or in the .bashrc file. The only difference in the code that runs on the laptop and the code that fails to run on the GCE is the new addition of _REDIRECT_URI (when creating the flow object)
Any suggestions to fix this mis-configuration are appreciated.
Original issue reported on code.google.com by ccliff...@archipelagois.com on 12 May 2015 at 9:57