timesys test automation solution (tas) with …...timesys test automation solution (tas) with...

2
Timesys Test Automation Solution (TAS) with Continuous Testing Built on open-source, and deployed behind your firewall Designed to complement and extend your existing test infrastructure, TAS is composed of six major components that include: Remote Access Embedded Board Farm (EBF): Features APIs to integrate test automation frameworks and develop test cases for embedded devices Test Framework: Pre-integrated LAVA test automation framework, extensible and bundled with open-source test case templates, test job wizard for scheduling tests, and email notification of test job status CI System: Pre-Integrated with Jenkins, a Continuous Integration (CI) system, enables continual testing to reveal functional and performance regressions at Linux kernel, OS, and application levels Development Environment and Build Systems Integration: Pre-integrated with Yocto BSPs and Timesys Factory BSPs Test Case Management: Built-in with creation of test cases, test suites, and test plans, and importing of existing test case capabilities Report Management: Report generation in multiple formats, report comparison between test job runs, and import of test reports from other test frameworks Develop new test cases, test suites and integrate existing test cases using Remote Access EBF APIs. Create test jobs for test automation and integrate them with Continuous Integra- tion frameworks like Jenkins. Generate reports for quality analysis and inspection, making the development process more effi- cient and enabling the delivery of higher quality products at lower cost. Zombie Zombie Zombie Zombie Enterprise Network Master Timesys Remote Access Embedded Board Farm (EBF) and Test Automation Test Repository Test Reports & Logs Artifact Storage CI Master Build Slaves Build Environments Yocto Project Timesys Factory Source Code Repositories Embedded Linux Dev Environment T e s t A u t o m a t i o n E mbedded Boar d Farm D e v e l o p m e n t C o n t i n u o u s I n t e g r a t i o n Artifact Storage CI Master Build Slaves Reports Test Automation Service and Embedded Board Farm Customer Network Test Repository Package Sources Test Reports & Logs Zombie 1 Dev Boards Zombie 4 Dev Boards

Upload: others

Post on 14-Jul-2020

18 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Timesys Test Automation Solution (TAS) with …...Timesys Test Automation Solution (TAS) with Continuous Testing Built on open-source, and deployed behind your firewall Designed to

Timesys Test Automation Solution (TAS) with Continuous TestingBuilt on open-source, and deployed behind your firewall

Designed to complement and extend your existing test infrastructure, TAS is composed of six major components that include:

• Remote Access Embedded Board Farm (EBF): Features APIs to integrate test automation frameworks and develop test cases for embedded devices

• Test Framework: Pre-integrated LAVA test automation framework, extensible and bundled with open-source test case templates, test job wizard for scheduling tests, and email notification of test job status

• CI System: Pre-Integrated with Jenkins, a Continuous Integration (CI) system, enables continual testing to reveal functional and performance regressions at Linux kernel, OS, and application levels

• Development Environment and Build Systems Integration: Pre-integrated with Yocto BSPs and Timesys Factory BSPs

• Test Case Management: Built-in with creation of test cases, test suites, and test plans, and importing of existing test case capabilities

• Report Management: Report generation in multiple formats, report comparison between test job runs, and import of test reports from other test frameworks

Develop new test cases, test suites and integrate existing test cases using Remote Access EBF APIs.

Create test jobs for test automation and integrate them with Continuous Integra-tion frameworks like Jenkins.

Generate reports for quality analysis and inspection, making the development process more effi-cient and enabling the delivery of higher quality products at lower cost.

Zombie

ZombieZombie

Zombie

Enterprise Network

Master

Timesys Remote Access Embedded Board Farm (EBF) and Test Automation

TestRepository

Test Reports & Logs

Artifact Storage

CI Master

Build Slaves

Build EnvironmentsYocto Project

Timesys Factory

Source Code Repositories

Embedded Linux Dev Environment

Test Automation

Embedd

ed Boa

rd Far

m

Dev

elopment

Continuous IntegrationArtifact Storage

CI Master

Build Slaves

Reports

Test Automation Service and Embedded Board Farm

CustomerNetwork

TestRepository

Package Sources

Test Reports& Logs

Zombie 1Dev Boards

Zombie 4Dev Boards

Page 2: Timesys Test Automation Solution (TAS) with …...Timesys Test Automation Solution (TAS) with Continuous Testing Built on open-source, and deployed behind your firewall Designed to

EMEA Officeul. Palmowa 1A, 62-081 Chyby POLAND +48.53.733.8080 [email protected]

Headquarters / North America Office 1905 Boulevard of the Allies, Pittsburgh, PA 15219 UNITED STATES 1.866.392.4897 [email protected]

APAC Office3rd Floor, Jaag Homes, Achyutha Square, No. 3, MTH Road, Villivakkam, Chennai, Tamil Nadu – 600 049 INDIA [email protected]

Copyright © 2019 Timesys Corporation. All Rights Reserved. Rev. 2-20200817-A Timesys and the Timesys logo are registered trademarks of Timesys Corporation. Linux is a registered trademark of Linus Torvalds in the United States and other countries. All other company and product names mentioned and marks and logos used are trademarks and/or registered trademarks of their respective owners.

TAS comes with some pre-integrated components as well as APIs to enable easy integration of other components:

To learn more about the Timesys Test Automation Solution, email us at [email protected] or call us at 1.866.392.4897 (toll-free) or +1.412.232.3250 to schedule a compli-mentary, no-obligation consultation.

Benefits of the Timesys Test Automa-tion Solution include:

• Code quality — Ability to track and show consistency and measurable improvement in code quality by comparing results over time

• Functional regression — Ability to catch functional regression early in the development cycle

• Performance regression — Enables timely discovery of performance degradation vs. waiting for the QA/Validation cycle

• Continuous development — Inte-gration with Timesys Board Farm Cloud enables discovery of bugs and performance issues early in the development cycle

• Repeatability — Variability in testing methodology implicit with manual testing is eliminated

• Release ready — Reduces cycle time for release preparedness, important for bug fixes and vulnera-bility patches

• Summarized reports — Enables easy comparison of reports

• Easy integration with your existing workflow

• Build and source code manage-ment (SCM) system independent

• CI integration service• Track and trace — Documentation

to assist certification or internal audit for development maturity models

• Accessible via browser from anywhere• Continuous integration system plugins:

Jenkins- CI configuration policies- Artifact (build image) storage policies- Easy to integrate plugins for other CI

(Bamboo, Buildbot) • Source code management integration: Git

- Easy to integrate other SCM (SVN, ...) • Build system integration: Yocto, Factory

- Easy to integrate other build systems (Buildroot, Android, Soong, …)

• Test automation framework for pipelining and executing the tests: (LAVA, Squish*)- LAVA Test Jobs- Job Definition wizard- Create, View, Delete, Refresh & SaveAs- Sample YAML- API to submit Saved Test Job use by CI

(e.g. Jenkins)- Test execution over Serial and SSH- Job run across reboot (e.g. crashme)- Manual and automated scheduled exe-

cution- Test Job Run details and logs- Commandtine tests using shell on DUT

for output verification• Scheduling policy management (Jenkins,

manual)• Test repository (basic built-in)

- User Defined Tests- Test Editor- Import existing test scripts and binaries

• Test case templates- Iperf (network performance)- Lmbench (performance analysis)- Bonnie (filesystem performance)- Crashme- LTP (Linux Test Project)

• Device layer: 24x7 availability of boards with APIs for executing the automated tests (Timesys EBF)- Multi-user Support (login controlled)

• Enables multiple users to connect into the cloud simultaneously, while allowing each logged in user to control can use different boards con-nects into the cloud simultaneously

- APIs for automation• GPIO (bit or byte)• SD card switch• USB memory switch• USB hotplug• Ethernet hotplug

- Boot Medias• SD card (multiple partitions), USB,

Network Boot (tftp/nfs)• Reporting

- Generate mulitple formats (html, xml, xls, JUnit)

- Report comparison- Report notification via email

Test Automation Solution (TAS) WorkflowFlexible and extensible, Timesys’ TAS allows integration with other CI systems, build systems,

test frameworks and test case management software.