Skip to main content

Integrating voice command with Power BI (Cortana for Windows and Q&A virtual voice analyst for iOS)


When we are doing any kind of solution our main focus is to satisfy our end users and to deliver a very user friendly solution in the end. We need to make their lives simple and it can be done by many means and one of them is allowing them to use voice commands to serve their purposes.

In this blog first of all we will create a Cortana card in Power BI and allow the end user to view their interests by voice command in windows devices, then we will download Power BI application from app store and use Q&A voice command to get insights, currently there is no proper way of integrating Power BI and voice command in android devices but it will be there in near future.

Important pre requisite

You need to have Power BI pro account in order to share a Cortana card via an app, this can be created in Power BI services including end user for him or her to be able to integrate that to their Cortana and to activate it using voice command or by a simple search.

You need to have dash boards where important reports and visuals are pinned in the app created in the Power BI services in order to get insights using voice command in ios devices.

What is Cortana?

Cortana is a voice-controlled virtual assistant for Microsoft Windows. Comparable to Siri, the intelligent assistant enabled on Apple devices, Microsoft's Cortana will use the Bing search engine and data stored on the user's device to make personalized recommendations.

Creating a Cortana card in Power BI

Cortana card can be created as a report in Power BI while setting page size to “Cortana”. Creating visual is also same as the normal report creation, you can add visuals in the allotted space. Cortana size is very small comparing to a normal report, it is better to add two visuals, three is ok but more than that will clutter the screen.

Have a look at the following image to get an idea about Cortana Card, in the format pan you can notice that I have selected the “Cortana” as page size and named my Cortana card report as “Voting Cortana” while giving “Comparison of Voting” as a synonym in the left vertical task bar.


My Cortana card visual is lame but just for a demo right so don’t mind it.

Creating Power BI app and publishing Cortana card.

To create an app you need to login to Power BI services which has to be a pro activated one and there you need to expand the Work spaces in the left most vertical task bar and click on “Create app workspace”, then in the right most part of the screen you will get some details to provide for the app. I named it Cortana and made the availability private which means only the people I add to this app can view it, also I can restrict their role by only letting them to view the data or let them be an admin if I want to. Once you are done save and create the app. In the below image you can see the preview of app creation.



Now it is time for us to publish our Cortana card to Power BI app which has the end users integrated on it, you can simply do this by publishing and selecting the app name when publishing and you are good to go in my case the app name is Cortana.

Important – In order for Cortana and Q&A to use this report and data we need to enable that in the settings of Power BI services.

Steps to be completed are given below

1.      Select the app you have created from the work space
2.      Go to settings
3.      Go to dataset
4.      Go to Q&A and Cortana
5.      Tick that and activate it


Check the above image for further clarification.

Configuring Cortana to support Power BI

Pre requisites

1.      Must be running Windows version 1511 or later
2.      Only supported by English
3.      Windows and PBI accounts has to be linked
4.      Cortana has to be connected to Office 365


You can check your windows version in “about your pc” mine is 1703.

You need to login to Cortana using your Microsoft credential and also you need to login to the office 365 which you can find in the note book of Cortana under the connected services as you can see below.
                                                              

It is important to add the account linked to Power BI in the “access work or school” of the “manage your account” simply add the account linked to Power BI to your computer in the settings.

The same steps has to be performed in the end user computer to support Cortana and Power BI integration. There the credentials of the end user which has been given permission to access the app in our work space has to be used.

Once you have successfully completed the above steps restart your computer for the settings to take place, now you can call your Cortana report by it's name in my case the name is "Voting Cortana" or by using a synonym you gave it in my case I gave a synonym "Comparision of voting" , end users who have been given access to it via app can do the same too.

When you use voice command and say the name or synonym of a Cortana card then Cortana will show you what you asked for like a magic.


How does Cortana card look in a laptop or desktop which runs windows OS ? see below




Using Q&A voice command in iOS devices.

In iOS devices such as iPhone and iPad we can use voice command to get quick insight and navigate through our data. In order to do this first of all we have to install the power Bi app from the app store and the link is given below.


In the iOS device you should login with the power BI credentials which has access to the power BI services where you have all your dash boards and reports uploaded.

Once you have success fully login with your credentials go to your dash board and check whether the dashboards are available, in my case I have them all up to date.


There I selected the dash board "Voting Cortana" which I have created and the visuals are pinned in the dash board as shown below.


In the bottom there is an icon like this Q&A virtual analyst icon  press that and access Q&A where you can ask your natural language questions on your data set and the best part is there you can use voice command to ask your questions and no need to type at all like shown below.



The Q&A has a well-developed machine learning algorithm and depending on your usage the predictions get better day by day and also you can give feedback for the results by just long pressing the Q&A result and selecting happy face if the result is satisfying or the frown face if that is not what you are expecting like shown below.


This way you can use voice command to get what you need with ease in iOS devices.

These two methods will help to create an environment where the developer can keep updating while the end user will be able to view the content using voice command if they are using windows or iOS device.











Comments

Popular posts from this blog

Choosing color scheme for Power BI reports

Choosing beautiful colors for an attention seeking Power BI report is always challenging. Sometimes we may have an important message but it might go unseen if proper color scheme is not used, so it is important to create reports which are informational and visually appealing. In this blog our main objective is to get an idea about selecting appropriate color scheme and tools that can be beneficial to do this. What is a color scheme? As you all know not all colors look great together and you can tell stories by just having only two colors, have a look at the following image, there in the middle you can see a circle with same color and same dimension, only thing that changes is the back ground, but depending on the back ground the way you see those circles are totally different. Some small circles appear softer, some appear sharper, and some are brighter also you might notice movements or depth effect too. It is important to choose colors wisely to serve the purp

Ragged hierarchy in Power BI

Case- I have a data set which has to be visualized in a ragged hierarchy. What is ragged hierarchy A ragged hierarchy is a user defined hierarchy with an uneven number of levels.   You can see the above table which has 5 levels of hierarchy. In the first level we only have “World” as a category then moving forward to the next level we have two categories  namely “UK” and “USA” likewise the level of hierarchy is drilling down up to five levels with an uneven amount of categories. Creating a hierarchy in Power BI In the above image  you can notice that I have right clicked the “level 1” column which has to be the first level of our hierarchy, Once it is right clicked there you will notice “New hierarchy” as the second option then you will have to click that in order to create a new one. As you can notice in the above image once I have created a new hierarchy then a new column is created named “Level 1 Hierarchy” in that I have dragged and dro

Five tips to enhance a tableau model with usability features.

In the previous blogs I was more focused in Power BI since i work with it day to day, but this time we are going to dig into increasing the usability features of tableau. This blog revolves around the end-user simplicity, if a model is hard to comprehend then it will be a disaster, so we should deploy some means to stay simple. So without further ado lets head on to the first topic of the day. Configuring table and  column  properties. A model can consist of many tables but the important fact is they have to be unique and it is better if we can have a table description to elaborate on whats it about. This can be also considered as an internal documentation, when a project member is changed it is easy to pick up and continue. We use connections to load data for the tables and we have a connection name for it but once if we set the source it cannot be changed in the latter part, so be mindful because once you are dropping a connection you are losing all the tables assoc