Windows 10: Automate applications with Win10?

ezrtaheraahrer · Jul 28, 2020

How can I automate on windows 10 that something like bluestacks is done automatically while I am doing something else in another window?

:)

shankar3008 · Jul 29, 2020

Mobile Application Automation

Hi,

I would like to know if any one of you have any information about automating Windows mobile application? The aim is to run the automation tests on the device.

shankar3008 · Jul 29, 2020

Mobile Application Automation

I wanted to know is there a tool or procedure to do functional automation on the applications which are deployed over a handset.

Something like what we do on the Web application (Functional automation using some of the tools like SAHI or Winrunner etc... which eventually used for Regression Testing)

In this case for example: I would like to test couple of SMS Compose scenarios, instead of doing it manually I want to automate it so that it runs a script/ set of instructions which will verify this scenario.

Please let me know in this regard.

thanks,

Tenforo · Jul 29, 2020

Support for Pen with Windows Application Driver v1.1 Preview

Windows Application Driver (WinAppDriver) is continuing Microsoft’s investment in UI test automation tools for Windows 10, and now, we’re excited to announce the next release of WinAppDriver—version 1.1!

A preview is available today— bringing support for Pen automation. The full v1.1 release is also on the horizon and will feature support for Multi-Touch in addition to Pen.

pxv8elFZY7g

What is WinAppDriver?

For those of you who aren’t familiar with WinAppDriver or UI automation, WinAppDriver is an open-standards based UI automation service designed to work with all kinds of Windows 10 applications including WPF, WinForms, legacy Win32, and UWP. By complying with an open-standard, WinAppDriver users will be able to leverage the robust UI automation ecosystem already provided by Appium and Selenium.

What’s new in the v1.1 Preview

In v1.1, we’re aligning with the W3C WebDriver standard, and as a result, implementing the Actions API to bring in advanced input device support.

The Preview release of v1.1 includes the following:

WinAppDriver updated for Pen, including support for advanced Pen functionality:

Pressure

Tilt X & Tilt Y

Twist

Barrel button

Eraser support

Appium-Dotnet-Driver NuGet Package

This is a preview Nuget package with updated bindings to enable Pen automation on WinAppDriver.

Samples & Documentation on GitHub

Note that the full release will also include support for Multi-Touch – more details on that below.

Getting Started with Pen

You can download the preview version of WinAppDriver on our GitHub page here: Releases · Microsoft/WinAppDriver · GitHub.

To get started on using Pen, we highly recommend checking out our new Sticky Notes sample here.

Let’s sketch out a quick smile

To demonstrate something a little more complex than a few strokes on a sticky note, we tried drawing out the following smiley face through the following steps–

Step 1 – Using Pen to draw a basic Circle

[table][tr][td]1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25[/td] [td]//Initiate a Pen object using the custom Dotnet Driver Bindings. PointerInputDevice penDevice = new PointerInputDevice(PointerKind.Pen); ActionSequence drawSequence = new ActionSequence(penDevice, 0); //Set starting position of circle by its center point. var centerX = canvasCoordinate.X + canvasSize.Width / 5 + 285; var centerY = canvasCoordinate.Y + canvasSize.Height / 5 + 270; //Radius of circle. var radius = 200; /* This value will dictate the granularity of the number of stokes to complete the strokes. The more steps, the less blocky the circle will be. Note: Sticky Notes will interpolate between the steps anyway, so it will not appear blocky if Pen is not lifted. */ var steps = 50; // These two variables will calculate either the X or Y coordinate around the center of the circle for a given step. int xValue = (int)(centerX + radius * Math.Cos(2 * Math.PI * 0 / steps)); int yValue = (int)(centerY + radius * Math.Sin(2 * Math.PI * 0 / steps)); drawSequence.AddAction(penDevice.CreatePointerMove(CoordinateOrigin.Viewport, xValue, yValue, TimeSpan.Zero)); drawSequence.AddAction(penDevice.CreatePointerUp(PointerButton.PenFrontTip)); /* Function to draw circle by calculating coordinates around center point and brushing through them. */ for (var i = 0; i <= steps; i++) { xValue = (int)(centerX + radius * Math.Cos(2 * Math.PI * i / steps)); yValue = (int)(centerY + radius * Math.Sin(2 * Math.PI * i / steps)); drawSequence.AddAction(penDevice.CreatePointerDown(PointerButton.PenContact)); drawSequence.AddAction(penDevice.CreatePointerMove(CoordinateOrigin.Viewport, xValue, yValue, TimeSpan.Zero)); } //Lifting pen up once Circle is drawn. drawSequence.AddAction(penDevice.CreatePointerUp(PointerButton.PenContact)); //Final step would be to execute the sequence. newStickyNoteSession.PerformActions(new List<ActionSequence> { drawSequence });[/td] [/tr] [/table]

Step 2 – Adding in the smile

We’ll have to get a little clever with this part, and modify the original for-loop from step 1 and add supplementary code following it. This will continue the same sequence.

[table][tr][td]1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27[/td] [td]/* Loop modified to iterate past opening step and closing step of circle. This will create an opening for the smiley ìmouthî. */ for (var i = 0; i < steps; i++) { xValue = (int)(centerX + radius * Math.Cos(2 * Math.PI * i / steps)); yValue = (int)(centerY + radius * Math.Sin(2 * Math.PI * i / steps)); if (i > 1){ drawSequence.AddAction(penDevice.CreatePointerDown(PointerButton.PenContact)); } drawSequence.AddAction(penDevice.CreatePointerDown(PointerButton.PenContact)); drawSequence.AddAction(penDevice.CreatePointerMove(CoordinateOrigin.Viewport, xValue, yValue, TimeSpan.Zero)); } drawSequence.AddAction(penDevice.CreatePointerUp(PointerButton.PenContact)); /* The following vars will calculate X & Y coordinates for start and end point of the smile. */ var xSmile = (int)(centerX + radius * Math.Cos(2 * Math.PI * 1 / steps)); var ySmile = (int)(centerY + radius * Math.Sin(2 * Math.PI * 1 / steps)); var xSmile2 = (int)(centerX + radius * Math.Cos(2 * Math.PI * (steps - 1) / steps)); var ySmile2 = (int)(centerY + radius * Math.Sin(2 * Math.PI * (steps - 1) / steps)); /* Continue previous sequence and execute the Pen actions. */ drawSequence.AddAction(penDevice.CreatePointerMove(CoordinateOrigin.Viewport, xSmile, ySmile, TimeSpan.Zero)); drawSequence.AddAction(penDevice.CreatePointerDown(PointerButton.PenContact)); drawSequence.AddAction(penDevice.CreatePointerMove(CoordinateOrigin.Viewport, centerX, centerY, TimeSpan.FromMilliseconds(400), new PenInfo { Pressure = .600f })); drawSequence.AddAction(penDevice.CreatePointerUp(PointerButton.PenContact)); drawSequence.AddAction(penDevice.CreatePointerDown(PointerButton.PenContact)); drawSequence.AddAction(penDevice.CreatePointerMove(CoordinateOrigin.Viewport, xSmile2, ySmile2, TimeSpan.FromMilliseconds(400))); // Execute sequence. newStickyNoteSession.PerformActions(new List<ActionSequence> { drawSequence });[/td] [/tr] [/table]

The additional pressure applied to the “smile strokes”—this is to add depth to the smile. The sketch should appear as the following:

Step 3 – Eyes

If we wanted to finish up and add eyes, it would look something like the following:

There’s a lot of clever ways you can go on about adding the eyes, so we’ll let you decide which way is best. The full code for our design will be included as part of the Sticky Notes sample on GitHub!

Details on full 1.1

The full release of v1.1 will come with the following additions:

WinAppDriver

Pen—support for Pen will be carried over to full 1.1 release from the Preview.

Multi-Touch—support for Multi-Touch will be added in as well through the Actions API. The following touch modifiers will be supported:

Pressure

Twist

New Samples & Bindings

Samples from the Preview will be further expanded to demonstrate Pen and Multi-Touch functionality. The samples will incorporate a private Appium-Dotnet-Driver Nuget feed that will enable Actions implementation via the new bindings. We’re looking into having these changes be merged into the official Appium .Net Driver, and eventually be rolled-up to the Selenium Namespace in the future.

Release Date

We’re targeting this June for the full release of v1.1—stay tuned to our GitHub board for more info!

Moving Forward

The WinAppDriver team will continue to work on adding new features, resolving bugs, and improving performance. We’ve been looking into popular community requests, and as such, have a couple of cool things in the pipeline for 1.2 and beyond—one in particular being to improve performance with XPath handling.

We’ll also be releasing a new tool for the community – more details on this to follow in the coming weeks. Stay tuned!

How do I provide feedback?

Please provide feedback on our Github issue board – we look forward to hearing about any suggestions, feature requests, or bug reports!

microsoft/WinAppDriver

If you have any cool sketches done through v1.1 that you’d like to share—do so on the GitHub board! It may even be featured in a future blog post!

Stay Informed

To stay up to date with WinAppDriver news follow @mrhassanuz.

Summary

The v1.1 Preview is available now—enabling users to automate Pen scenarios. Full release for v1.1 to follow, and with it will bring support for Multi-Touch as well. Head over to our releases page on GitHub to download the preview, and get a jump-start on Pen automation by reviewing our updated samples.
Click to expand...

Source: Announcing support for Pen with Windows Application Driver v1.1 - Preview available now - Windows Developer Blog

Windows 10: Automate applications with Win10?

Automate applications with Win10?

Automate applications with Win10?

Automate applications with Win10?

Automate applications with Win10? - Similar Threads - Automate applications Win10

Launching applications and snapping windows in Power Automate

Launching applications and snapping windows in Power Automate

Where to download "Applications crash when automated by a UI Automation client app in...

Where to download "Applications crash when automated by a UI Automation client app in...

Can you automate changing default application for a file type?

Can you automate changing default application for a file type?

Win10 Application Delete With Cmd

Automate LOGIN

Automated Win10 Installation?