Authentication to Azure Provider #374

vwake7 · 2024-03-01T05:19:22Z

vwake7
Mar 1, 2024

I am trying to authenticate Azure Provider using
stackql shell --auth="${AUTH}"
Can you provide me a sample of what keys need to be provided in AUTH. I provided Service principal credentials using export variables and got below error

stackql Command Shell 0.5.587
Copyright (c) 2021, stackql studios. All rights reserved.
Welcome to the interactive shell for running stackql commands.
INFO[0000] opened db with file = 'file::memory:?cache=shared' and err  = '<nil>' 
INFO[0000] getNextSessionID(): generation id = 1, session id = 1 
INFO[0000] stylised write called                        

INFO[0000] stylised write called                        
INFO[0000] stylised write called                        
stackql  >>INFO[0015] stylised write called                        
INFO[0015] stylised write called                        
stackql  >>select * from azure.compute.virtualmachines ;INFO[0017] stylised write called                        
INFO[0017] stylised write called                        
stackql  >>select * from azure.compute.virtualmachines ;INFO[0017] stylised write called                        
INFO[0017] stylised write called                        
stackql  >>select * from azure.compute.virtualmachines ;
DEBU[0017] you said: "select * from azure.compute.virtualmachines ;" 
INFO[0017] stylised write called                        
DEBU[0017] PrepareQuery() invoked...                    
DEBU[0017] tcc = &{0xc00070a1d8 1 1 1 1 0xc00070a1d0  []} 
DEBU[0017] node = &{<nil> false false false [] [0xc0007183c0] [0xc000718400] <nil> [] <nil> [] <nil> } 
DEBU[0018] optimistic doc error: Service.GetResource() failure 
DEBU[0018] node = &{<nil> false false false [] [0xc0007183c0] [0xc000718400] <nil> [] <nil> [] <nil> } 
DEBU[0018] canRoute = false, routeType = 2              
DEBU[0018] node = &{<nil> false false false [] [0xc0007183c0] [0xc000718400] <nil> [] <nil> [] <nil> } 
DEBU[0018] canRoute = false, routeType = 2              
INFO[0019] stylised write called                        
Service.GetResource() failure
INFO[0019] stylised write called

Answered by jeffreyaven

Mar 9, 2024

I think you may be missing an underscore @vwake7 virtual_machines

View full answer

vwake7 · 2024-03-07T04:36:37Z

vwake7
Mar 7, 2024
Author

ok I was able to get authorized to Azure using az login workflow, but how should I get authorized when I programatically invoke pystackql. @jeffreyaven . Any help is appreciated.

4 replies

jeffreyaven Mar 7, 2024
Maintainer

Hey @vwake7 pystackql should inherit the auth on the current system

vwake7 Mar 7, 2024
Author

@jeffreyaven, Is that the only way to get authorised for batch jobs?

vwake7 Mar 7, 2024
Author

@jeffreyaven , I meant is there any way I can set the auth through a dictionary or Json, if you can point me to an azure example, it will be helpful. I can't find what keys and values need to be provided in the dictionary.

jeffreyaven Mar 7, 2024
Maintainer

Hey @general-kroll-4-life can you help @vwake7

general-kroll-4-life · 2024-03-07T22:16:39Z

general-kroll-4-life
Mar 7, 2024
Maintainer

@vwake7 hiya and thanks for driving this. We do actually support this, please check out https://github.com/stackql/stackql/blob/main/docs/auth.md#azure-auth

If you want full automation, these are starting points:

4 replies

vwake7 Mar 8, 2024
Author

Thanks, will check and get back

general-kroll-4-life Mar 9, 2024
Maintainer

@vwake7 cheers, please reach out if you are stuck. We want to make sure it works for you

vwake7 Mar 9, 2024
Author

@general-kroll-4-life , I am getting Service.GetResource() failure error, Is this an auth error?

root@4ef7e6e8a0df:/opt/stackql# export AZURE_TENANT_ID="1"
export AZURE_CLIENT_ID="2
export AZURE_CLIENT_SECRET="3"
export AZURE_SUBSCRIPTION_ID="4"
root@4ef7e6e8a0df:/opt/stackql# stackql shell --auth="{ "azure": { "type": "azure_default" }}" --loglevel=debug
INFO[0000] stylised write called                        

INFO[0000] stylised write called                        
stackql Command Shell 0.5.587
Copyright (c) 2021, stackql studios. All rights reserved.
Welcome to the interactive shell for running stackql commands.
---
INFO[0000] opened db with file = 'file::memory:?cache=shared' and err  = '<nil>' 
INFO[0000] getNextSessionID(): generation id = 1, session id = 1 
INFO[0000] stylised write called                        

INFO[0000] stylised write called                        
INFO[0000] stylised write called                        
stackql  >>INFO[0010] stylised write called                        
INFO[0010] stylised write called                        
stackql  >>select * from azure.compute.virtualmachines ;INFO[0012] stylised write called                        
INFO[0012] stylised write called                        
stackql  >>select * from azure.compute.virtualmachines ;INFO[0012] stylised write called                        
INFO[0012] stylised write called                        
stackql  >>select * from azure.compute.virtualmachines ;
DEBU[0012] you said: "select * from azure.compute.virtualmachines ;" 
INFO[0012] stylised write called                        
DEBU[0012] PrepareQuery() invoked...                    
DEBU[0012] tcc = &{0xc0003b8348 1 1 1 1 0xc0003b8340  []} 
DEBU[0012] node = &{<nil> false false false [] [0xc000500400] [0xc000500440] <nil> [] <nil> [] <nil> } 
DEBU[0013] optimistic doc error: Service.GetResource() failure 
DEBU[0013] node = &{<nil> false false false [] [0xc000500400] [0xc000500440] <nil> [] <nil> [] <nil> } 
DEBU[0013] canRoute = false, routeType = 2              
DEBU[0013] node = &{<nil> false false false [] [0xc000500400] [0xc000500440] <nil> [] <nil> [] <nil> } 
DEBU[0013] canRoute = false, routeType = 2              
INFO[0014] stylised write called                        
Service.GetResource() failure
INFO[0014] stylised write called

jeffreyaven Mar 9, 2024
Maintainer

I think you may be missing an underscore @vwake7 virtual_machines

Answer selected by vwake7

Uh oh!

Authentication to Azure Provider #374

Uh oh!

vwake7 Mar 1, 2024

Replies: 2 comments · 8 replies

Uh oh!

vwake7 Mar 7, 2024 Author

Uh oh!

jeffreyaven Mar 7, 2024 Maintainer

Uh oh!

vwake7 Mar 7, 2024 Author

Uh oh!

Uh oh!

vwake7 Mar 7, 2024 Author

Uh oh!

jeffreyaven Mar 7, 2024 Maintainer

Uh oh!

general-kroll-4-life Mar 7, 2024 Maintainer

Uh oh!

vwake7 Mar 8, 2024 Author

Uh oh!

general-kroll-4-life Mar 9, 2024 Maintainer

Uh oh!

vwake7 Mar 9, 2024 Author

Uh oh!

jeffreyaven Mar 9, 2024 Maintainer

vwake7
Mar 1, 2024

Replies: 2 comments 8 replies

vwake7
Mar 7, 2024
Author

jeffreyaven Mar 7, 2024
Maintainer

vwake7 Mar 7, 2024
Author

vwake7 Mar 7, 2024
Author

jeffreyaven Mar 7, 2024
Maintainer

general-kroll-4-life
Mar 7, 2024
Maintainer

vwake7 Mar 8, 2024
Author

general-kroll-4-life Mar 9, 2024
Maintainer

vwake7 Mar 9, 2024
Author

jeffreyaven Mar 9, 2024
Maintainer