- Coming up, we give you a roundup
of the latest infusion
of artificial intelligence in Office
to find relevant content expertise
as you search for information
on author in Office,
up-level your presentations and documents
through automated design
assistance in PowerPoint
and the integration of mixed reality,
uncover hidden insights in your data,
focus your inbox and use Cortana at work
to manage your calendar,
and even use AI to
proactively protect yourself
and your data at work.
(techno music)
I'm joined once again by Jack Elmore.
Welcome back.
- Good to be back, Jeremy, thanks.
- So AI is really infusing everything now,
everything from our device at home
and things in our car, in the office,
and we've been infusing AI, really,
in our applications at
Microsoft for a while now
under the covers.
- Yeah, Office has been
focused on intelligent features
for 20 plus years,
and so what's exciting
is AI and the cloud-powered capabilities
start to really unlock creativity,
reason over large amounts of data,
and do some fantastic things
that come alongside your work,
help you create professional results
without getting in the way.
- Alright, so let's make this real
for the people watching at home.
What can we do now as
an everyday Office user?
- I've got a couple scenarios
that I'll show you today, Jeremy.
First, I'm gonna start
with, well, my resume.
As you know I'm looking for
my next opportunity here.
And so I'm gonna pull up my resume
and what do you notice
on the right-hand side?
There's the Resume Assistant coming up.
It's powered by LinkedIn.
- [Jeremy] So AI has detected
that the resume is a resume file
and opened that up?
- [Jack] It's done more than that.
Detected that it's a
resume and that the name
matches the user name.
So it's mine. It knows that this is,
I'm not looking at someone
else's but this is my resume.
And so it's actually
captured my job title here
and you'll notice some
of Word's Cloud-powered
editor features, like for example,
'think outside the box'
it's suggesting you know
maybe I should use 'think freely',
instead of saying 'young
blood' maybe I should...
so it's helping me
improve my writing style
that extends beyond just resumes.
But the resume assistant is actually
sorting out some similar resumes.
Now LinkedIn has profiles on
over a half a billion people.
- [Jeremy] It's a lot of people.
- [Jack] So you can start to
use AI to say, you know what,
here are some resumes and ways
that others have described
their work experience similar to yours.
A lot of people suffer
from blank-page syndrome
when they start working on a resume.
It's not something that we do everyday.
- [Jeremy] Right, this will
really help people get started.
- [Jack] Yeah so as I click into these
and I say 'Hey I wanna
see some more examples.'
I can filter those examples by different
related disciplines,
as I scroll down I get some
ideas like hey you could see
additional examples on LinkedIn.
And then if I wanna get really
creative I could say, you know what,
I wanna hire a professional to do this,
frankly I just, kinda want somebody else
to take care of it for me.
So there's a lot of great
information that's available here
right inside Microsoft Word.
But as I scroll down a little bit further,
what I can start to see is something
really interesting around skills.
So LinkedIn tracks a lot great
information on job postings
and the way that the
winning job applicants
are describing their skills
and then translating that to titles.
So here we can start to say,
these are some skills that I might have,
but I might not have
described them in a way
that's gonna generate the most hits,
and create the most matches.
So this is helping my resume to get seen.
Articles on writing your resume,
and even suggested jobs.
So you're in Seattle, we've got Starbucks,
we've got, you know, Amazon, Time Inc.
A lot of folks have got job postings
and I can even with a single
click let recruiters know
that I'm actually looking
for the next opportunity.
So whether you're brushing up your resume
for your next job internally,
or looking for your next opportunity
outside the organization,
Microsoft Word has a lot do to
help you publish your resume
in a way that's gonna
be exciting and engaging
using the power of AI.
- [Jeremy] Right, and
really what's happening here
behind the scenes is we're
taking some of the things like
search APIs and cognitive
services, we're doing the look-ups
against the information
that's in LinkedIn,
and then serving up those
results, so you're able to
really get some things that really match
what you're trying to do
in the Resume Assistant.
And the nice thing is
when I open up my resume,
it's just going to just
directly detect it's a resume
and if I don't find that,
and maybe I'm starting from scratch,
I can get straight to that
through the, which tab was it?
- [Jack] So under Review,
you'll see the Resume Assistant
here on the far right.
And that feature can be turned
on right under File, Options,
'Show LinkeIn features in
my Office applications'.
- [Jeremy] So you can get
it running right from there,
even if you start from scratch.
So, now, let's say you've landed your job,
you're on the next journey,
the next chapter of your life,
now how do I stay in the
job once I've got it?
- Yeah, that's right Jeremy.
So you've landed your role.
And you'll notice I'm using
Teams as my hub for teamwork.
Now the great thing about
this is I can go back in time
as the newest person joining the team.
I can see the relevant
chats and conversations
and get caught up.
I don't have to have people
send me a bunch of prior emails.
I can get connected
exactly to what's going on.
I want to show you one example
here with Microsoft Stream.
Now this is like a corporate YouTube
where you can publish videos.
But it has some really
unique capabilities.
Here's an example of the
Quarterly State of Contoso.
This is the CEO addressing the company.
I'm gonna click in and
see what Patti Fernandez
had to say at the last company All Hands.
So here I can consume this All Hands
right from within Teams.
But if I activate the full
Microsoft Stream experience,
you're gonna start to see
some additional capabilities
that are fueled by AI.
Let me show you a couple of those.
Here's Patti.
She's gonna begin speaking in a moment.
And as I scroll down, do you see here
three different people?
So it's actually sorting out
that like different people
are speaking during this video.
AI is determining who
those unique speakers are
and where they're speaking
inside the video itself.
So I can use it as a navigational element.
More importantly,
I can filter this relatively
lengthy CEO address
and say hey, I got hired to work on the
Mark 8 Quadcopter,
so I really just wanna kinda
see what Patti has to say
about the Mark 8.
When I type "mark 8",
that transcript is generated
automatically from the
spoken text and shows me it's
seven minutes and 43 seconds
that's where she...
- And that's quite cool cause it actually,
you did a search for the letter eight
and it actually found the
spelled out version of eight.
So it's actually done
some fuzzy matching there
as it transcribed the voice to text.
- Pretty intelligent.
- Really what we're seeing here
from an intelligent standpoint is
we're seeing computer vision.
So it's detecting the speaker
and who's actually talking
and then letting you jump
between those different speakers.
We saw with the heads
earlier in the different
parts of the video.
It's also transcribing the
video from voice to text.
And then based on that text
that's been transcribed,
it's enabling these search capabilities
that Jack just showed
by looking for "Mark 8".
- That's exactly right.
- Alright, so you're back in Teams now,
and I know you're working on Mark 8.
What else have you got going on?
- So, we've got a crew
working around-the-clock.
As the sun goes, so goes
the work around the world.
And so a team in France here
is working on a presentation
about the latest capabilities
and the status on the Mark 8.
So I'm gonna pull up
that presentation now.
The first thing you
gotta do is translate it
to a language so they can understand.
I don't know how to consume French,
but with PowerPoint's
Cloud-powered translator,
I can simply translate these
slides from French to English,
and in a matter of seconds,
I've got that same presentation now
translated using cognitive
services from French to English.
I'm gonna take these four
pictures here of our Mark 8
and in just a moment the
Cloud-powered designer pops up
and says, you know what,
here are some alternate examples or ways
you could lay out that slide.
That's pretty nice looking right?
- [Jeremy] It's not bad.
- [Jack] Better than what we had before.
- [Jeremy] A few other
recomendations you can make there.
This looks really good.
- [Jack] Yep. So I'm gonna
move on to the next slide.
And here you see that this
very wide angle photo,
clearly you need to
focus on the woman there,
just to the left of center.
And with salient region detection,
this is happening automatically,
intelligent cropping of the photo
to make this woman the hero of the slide.
As we move further, we've got
our development milestones
and when we plan to launch.
You can see November of this year.
And I can very quickly turn that
into an intelligent piece of smart art.
Now because this is just smart art,
I can visualize this information
in a number of different ways.
Including one of my favorites,
the arrow pointing toward the upper left.
So it's starting to look pretty good.
Yeah, Jeremy?
- [Jeremy] Much better so far.
- [Jack] And then, finally,
for a slide like this
that has the series of
call-to-action steps
that are prepended by a verb,
I can represent that as a numbered list,
or I can even go further down and call out
that specific verb to draw attention to
the action that I'm asking for.
- Very cool stuff.
So we saw you translate from
French to English earlier.
Is there anything else we can do there?
- Well I mentioned we're
a global organization,
so we've got a group in Asia
that we're gonna present this content to.
And I understand you may
speak a little bit of Chinese.
- (Jeremy speaking in Chinese)
- [Jack] Alright. So what we're gonna do
is take advantage of the other
national language capability
powered by cognitive services,
and we're going to
subtitle our presentation
as you present it.
So if you'd kindly put on
- Alright, let's see if this
your headset.
- works the other way around.
- [Jack] You're gonna to
speak simplified Chinese.
And we're gonna to subtitle it in English.
- I'm gonna try to speak
simplified Chinese.
- It's gonna be fantastic.
Okay, so before we get started,
here you can see a QR code.
And if you have the Microsoft
Translator app on your phone,
you can actually choose from
a library of over 60 languages
that you speak, and have
real-time simultaneous
subtitling consume it on your phone in,
for example, Portuguese or
some other language as well.
So what I'm gonna do now is
begin the slide presentation.
And I'll go off mute and
you can begin speaking.
- (Jeremy speaking in Chinese)
- How about that.
Pretty accurate?
- Not bad. That's exactly
what I was trying to say.
- [Jack] Fantastic.
So what you can see here is
in the global organizations
of today and of tomorrow,
look at all of the powerful
ways that we can communicate
and keep that cycle going
across the time zones, across
the world, across languages.
- Very cool. So we just saw some,
a lot of intelligence being applied
within the context of PowerPoint.
But I know you're working
on some other things
in terms of being able to
work with mixed reality also.
So what can we do there?
- So, I've shown you can
example of like an internal
status update presentation, right.
What I really wanna be able
to do is generate excitement
and demand for my Mark 8
before it's actually even
available on the market.
I'd like to sell some pre-orders.
So I've got an example here of
a two-customer presentation.
And you know we've been
able to insert pictures
inside of PowerPoints for many many years
but what is new is this
ability to add 3D models.
So I've got a 3D model
here of my quadcopter,
and you can kinda see I
can rotate that there.
I've got a variety of
different ways I've positioned
that same image across multiple slides
to call attention to different features.
- [Jeremy] And the nice thing
is if you're using PowerPoint
now you can test that by using 3D images.
Even if you don't have things handy,
just by going through and
finding those through the
kinda the remix archive.
- That's exactly right.
For example, if I went
up here to 3D Models,
and I said I wanna pull
from online sources,
you'll see a series of
very much like the online
pictures gallery as well
and search for something
that you're looking for.
- [Jeremy] But we can actually do
some pretty cool things.
We've shown morph in
the past with 2D images.
- We can do that here with
the 3D as well, right?
- Right, so the morph transition
automatically calculates
differences between slides.
And what I'm gonna do here is take a copy
of this quadcopter image and
simply paste it on slide two.
But I'm gonna make some adjustments.
Maybe I'm gonna rotate it a little bit
and move it down here
into the lower right,
to talk about the long-range control.
And then, as I animate my presentation
with the morph transition,
watch what happens.
I automatically calculate
differences between the slides
in a cinematic movie-like effect.
- [Jeremy] That looks amazing.
- [Jack] So when you combine
that morph transition
with all the other animations
that are in PowerPoint,
anybody can create a presentation
that looks like this,
incredibly professional.
Yes? Would you agree?
- Very cool. So you've
shown now, with designer,
showing how you can
make those other slides
go from kind of zero to hero in that case.
We've shown now with
morph and the 3D images.
But I know you can do
a bit more in terms of
mixed reality and what's
built-in with Windows 10.
- Yeah there's nothing like you seeing it
in the real world, to
create a sense of realism
and also to grab your
checkbook and buy that
first one that's coming
off the assembly line.
- Right, right. I'd love
to have a drone myself.
- That's right.
So here I've got that
same 3D quadcopter model
inside Windows 10 with mixed reality.
Now at the moment I'm
just viewing the model,
and of course I can, you know,
look at it from a variety
of different perspectives.
The same types of things we
observed there in PowerPoint.
But if I take this Surface device,
and I hold it here.
And I'll just point at the table
and tap the mixed reality button.
In just a moment, what
you're gonna see is,
we actually detect that
there's a hard surface there
and I can drop that quadcopter
right here into real space,
adjust it, and you'll notice
as I rotate the surface device,
it stays pinned in space and
I can even take a picture
and then e-mail that picture to you
to make sure that you're
as excited as I am
about purchasing one of these quadcopters.
- Alright. That looks amazing.
Yeah, I'd love to have
that here in the studio.
So, very cool. So we saw how PowerPoint
and kind of the Office
experience gets much better,
a lot of people though,
when they think about AI,
and they think about using intelligence,
they're really thinking about how they
can apply that to data.
So can we do anything with
Excel and AI together?
- Yeah, you bet.
So let me show you an example here
of a feature called Insights.
I'm looking at a bunch of data here.
In fact, it's a pretty sizeable amount.
If I go to the bottom here
it's about 4,466 rows of data.
- [Jeremy] It's quite a bit.
- [Jack] It's quite a bit.
And so what you typically
do here is start creating
some pivot tables and trying to
find trends in that information.
With a series of Cloud-powered algorithms
with Insights, I can simply
click that Insights button,
and you'll notice on the right-hand side,
we're doing some analysis,
we're running some
heuristics on this data,
and bringing back a series of
suggested things you might,
or trends that you may
or may not have observed.
So here I can see, for
example, spend by fiscal month,
spend by category,
ooh...
Marketing and people seem to be declining.
I hope I joined the right
team here at Contoso.
So I wanna take this chart
and say, you know what,
I wanna summarize that.
By the way 28 different results.
So there's quite a few more
we could browse through.
But in the interest of time,
I'm just going to simply take this chart
and we'll see that the
intelligence in Excel
has automatically created
a summary pivot table
and a chart that goes along with it.
- [Jeremy] That might
explain why the sales
have been dropping for the normal cameras.
- They need to double down
on my product I think.
- Right. So we really
wanna help save time.
What else can we do then, in
the context of work with AI?
- So I'll show you some great examples on
a PC and a desk environment,
or a mobile environment.
But, when you're mobile,
you're also using your phone, right?
More and more today.
And so it's really important
to be able to be productive
on the go as well as safe on the go
because you're also more
distractible when you're mobile.
So I'm gonna bring up my mobile phone here
and I'm gonna bring up
probably the application I use
more than any other, which is Outlook.
And in my inbox I've got
an email from Megan Bowen
and she's saying
hey I've been looking at
this Contoso Q2 sales data,
it's a power BI dashboard,
I'll tap the link,
and here I can see that, for example,
our camera sales have been declining,
quadcopters are increasing.
That's part of the business strategy.
You've got a mature market around cameras
and we're trying to launch a new category
to get to some new customers.
I wanna have a meeting with the team
to be able to discuss this in more detail
and how to capitalize
and take advantage of it.
But I don't have a personal
assistant back at the office,
so I'm gonna use Cortana to
help me schedule this meeting.
You'll notice I've copied Cortana
and I'm just gonna @ mention Lee
and add Lee to our discussion
and here you can kinda see I said
'Hey can you set up some time
tomorrow for us to meet?'
I'm gonna go ahead and send
that message to Cortana
and she's gonna, in the
background, consult the free busy,
find out when people are available,
and automatically schedule
this meeting for me.
And sure enough, there it is.
So now when I tap on the
message from Cortana,
we've got the right time set up,
we've got a meeting
that's established for us.
Pretty straight-forward.
- Saves a lot of time.
Especially when you're on mobile,
if you have to kinda
compare everyone's schedule.
So one of the things I
noticed in your inbox is
you're getting emailed already directly
from the CEO of the company?
- I like to make a big
impact fast on a new job.
But as I open this email from Patti,
what you'll notice is
intelligence in Outlook
is actually highlighting
the fact that this email
address is rather suspicious.
This is not the one Patti typically uses
to correspond with me.
Likely a phishing attack.
And so I think I'm going to hold off
on responding until I can
investigate a little bit further.
- It doesn't look too legit.
Of course we've built all of
this intelligence into Office,
now if you're a developer,
you can use as your cognitive services,
which includes things like
machine learning models,
and it's all hosted as a service,
so it's a really great way to add
valuable AI capabilities right
into your apps and websites.
Now, if you saw with Office,
each of those cognitive
services really provides
AI functionality spanning
vision, speech, language,
knowledge and search like we just saw.
So, Jack, are all of these
capabilities available now?
- Most are available today
are being rolled out as
part of the Office Insiders builds.
So sign up as an Office Insider,
and if you're on Office
365 and you're an admin,
you can enable targeted
release in your tennant
for everyone, or selected users today.
- And of course, if you want to see
the latest updates in action,
subscribe to the Mechanics
channel on YouTube
and follow us on Twitter.
That's all the time we have for this show.
Thanks for watching,
we'll see you next time.
