:::: MENU ::::

Software testing enthusiast.

The Different Types of Software Testing

,

 

Software testing is an important part of developing software. There are many different types of software testing, each with their own goals and methods.



Functional Testing

Functional testing is used to test the features and functions of a program. Functional testing includes Unit Testing, Integration Testing, System Testing and Acceptance Testing.

Functional testing can be used at any level of development: unit level (testing individual units), integration level (testing groups of units), system level (testing entire systems) or acceptance level (testing whole applications).


lambdatest

Non-Functional Testing

If you’re not a software developer, the terms “functional” and “non-functional” may sound like jargon. But they’re actually quite straightforward:

Functional testing refers to how well your application performs its intended tasks. If it’s supposed to help users search for flights and hotels, does it actually do that?

Non-functional testing is all about other factors that can affect how well your app works in real life — things like security and performance (how fast does it load?), usability (are there any confusing parts of the design), compatibility with different browsers or devices (will this app work on my phone?).

The problem with functional testing alone is that it doesn’t tell you much about whether your product will be successful in the real world — and as we’ve seen over time, many companies end up releasing products that don’t meet user needs because they didn’t include enough non-functional tests during development stages.

If you are interested more about Functional vs Non-Functional Testing. You can check my writing at https://medium.com/@k-hartanto/functional-vs-non-functional-testing-caf14e1766fe

 

lambdatest

Other Type of Testing

Other types of software testing include ad-hoc testing, back-end testing, browser compatibility and backward compatibility.

Ad-hoc testing is an unstructured form of testing with no reference to the test case, or without any plan or documentation in place. This type of testing is done manually at random intervals during the development cycle so that problems can be identified and fixed before they become too serious.

Back end testing is a type of software testing that checks the server or database of an application or software. In back-end testing, testers don’t use a GUI; they can directly connect to the database with proper access and run queries on it to verify data. Tester usually access it using an API.

Browser compatibility means making sure your website looks good across all browsers so that visitors don’t see any glitches when visiting from different devices such as computers, mobile phones or tablets.

Backward compatibility refers specifically towards older versions of operating systems like Windows XP which still has many users worldwide despite being discontinued over ten years ago now.”

lambdatest

Software testing is an important part of developing software.

Software testing is an important part of developing software. It’s a process of validating and verifying that a software application or computer system conforms to its operational requirements, and satisfies user needs.

If you are looking for software testing materials, training, and certification guides and much more, then Software Testing Help is the only website that you need. Access all the e-books, Courses Videos, and Online Training to get started right away.

Conclusion

I hope you found this article helpful. With so many different types of software testing, it can be hard to keep track of them all. The best way to learn about each type is by reading up on it and seeing how they work in practice!

MydoQA: Twitter | Blog | Instagram | Facebook

Connect with me

Krisnawan: Twitter | Linkedin | Medium

MydoQA: Twitter | Blog | Instagram | Facebook

Better AI Tool Than chatGPT in Creating Articles

 


It was like a never-ending circle of work that took a lot of time and effort.

But as time went by, I learned about AI, which helps you write articles in minutes instead of hours or days! This is how it works: You simply enter your idea into their platform, then choose from their list of pre-written topics or create your topic from scratch using their unique interface which simplifies writing for beginners as well as experts alike! Once you’re done with writing your article, simply share it on social media or save it for later publication when you have more time available!

What is AI?

AI stands for Artificial Intelligence. It is a type of software that mimics intelligence and can learn, think, and perform tasks by itself.

CopyAI is one of the many AI tools that can help you write better content.

CopyAI is a one-click, self-learning AI copywriter. Just tell it about your business and it will create a unique text for you in seconds. Now you can write a better article in less time. With CopyAI, it’s possible to craft a convincing article for your blog or offer in just a few clicks.

I use CopyAI to help with the process.

CopyAI is a writing tool that helps you write compelling copy for your product, service, or business. With its unique AI technology, it learns from the best in the industry and helps you create a better copy in less time.


 

It’s a great tool.

CopyAI uses artificial intelligence to create text that converts. It writes first drafts for blogs, homepages, ad copy, sales pages, social media pages, and more.


 

It’s also valuable for brainstorming ideas and coming up with creative ideas for articles.

CopyAI is a great tool that I use to help me improve my blog content. It’s also valuable for brainstorming ideas and coming up with creative ideas for articles.


 

Conclusion

I hope this has helped you understand what CopyAI is and how it can be used to help with your writing process. If you’d like to know an example, you can check my previous articles.

Testing Pyramid and Testing Ice Cream Cone | What is the difference?

,

 Image of Ice cream chart with a note from above: Manual Tests, End to End Tests, Integration Tests, and Unit Tests Image of pyramid chart with a note from above: End to End Tests, Integration Tests, and Unit Tests


lambdatest

What is Testing Pyramid?

Image of pyramid chart with a note from above: End to End Tests, Integration Tests, and Unit Tests
                                                               

  1. Unit Tests
  2. Service Tests
  3. User Interface Tests

It’s all about the cost

‘It costs almost five times more to fix a coding defect once the system is released than it does to fix it in unit testing.’

— Paul Grossman, IT consultant, in ‘Automated testing ROI: fact or fiction?’

Testing Pyramid Component

Unit testing focuses on individual pieces of code. This can give you a detailed view of the code’s quality and performance, enabling you to get fast feedback as to whether your changes will improve things. As such, it makes sense to automate them. Furthermore, automated unit testing makes it easier to pinpoint where problems are so that you can more quickly fix them.

It is expensive to automate high-level tests

As you climb up the testing pyramid, you will encounter issues like:

  • Test fragility (tests that break easily and unexpectedly, even when changes ‘shouldn’t’ have influenced the test)
  • Longer feedback time
  • Increased effort levels
  • Higher costs to implementation
  • More specialized knowledge required

Benefits of the test automation pyramid

  • Time and cost savings
  • Elimination of human error for accuracy
  • Ability to reuse, repeat, and scale application tests to meet your software requirements

What is Ice Cream Cone Pyramid?

Image of Ice cream chart with a note from above: Manual Tests, End to End Tests, Integration Tests, and Unit Tests

Why Ice Cream Cones Are Bad

The anti-pattern that followed the pyramid test pattern was the Testing Ice Cream Cone. Ice cream cone is what happens if you put the majority of testing effort into a manual test.

Resources

The Practical Test Pyramid

Ham Vocke Software has become an essential part of the world we live in. It has outgrown its early sole purpose of…

martinfowler.com

Your QA tester’s hierarchy of needs: what is the agile testing pyramid?

The agile testing pyramid helps testers understand how to implement automated testing. This valuable guide was…

www.onpathtesting.com

What is Testing Pyramid?

Does your development team have to wait longer for the test suite to run? Do they have to rerun the test suite…

www.headspin.io

Automated Testing Ice cream cone | Agility Maturity Cards by Agilitest

Automated Testing Ice Cream Cone (ATICC) is an antipattern which finds its root in the " Shift Left " principle. It is…

www.agilitest.com

The Software Testing Ice Cream Cone

Most companies only focus on manual testing at the start. Down the road they jumping head first into UI automation…

saeedgatson.com

Testing is Good. Pyramids are Bad. Ice Cream Cones are the Worst

Ice cream cones are the worst. Not all ice cream cones. Just the ones that model a testing approach for software…

medium.com

The Truth About End-to-End Testing

Much thought and planning has gone into how to structure software quality tests and a great deal, if not most of it…

www.qualitylogic.com

Testing Pyramid and Testing Ice Cream Cone

Can ChatGPT Replace Software Tester?

,

 

ChatGPT

I am very curious whether chatGPT can help in software testing or even replace the role of a software tester. So today I checked to see if chatGPT can replace QA in software testing. The target under test is http://zero.webappsecurity.com/login.html. The figure below is the front page.

Front page of http://zero.webappsecurity.com

What is ChatGPT?

ChatGPT is a variation of the GPT (Generative Pre-training Transformer) language model developed by OpenAI. It is pre-trained on a large dataset of conversational text and can be fine-tuned for a variety of natural language understanding tasks such as dialogue systems and question answering.

How do I generate test scenarios and what is the result

In this fun experiment, I will make chatGPT to create a test scenario by writing a few sentences at the prompt.

Create a test scenario for the website’s front page

For the first experiment, I’ll have chatGPT create a test scenario for the target website. The prompt I’m using is “generate test case scenario for this site http://zero.webappsecurity.com/". And the result is shown in the attached image.

ChatGPT Result for a positive scenario

The result is quite good actually. It can write a test scenario systematically. The scenario is pretty basic. It only covers seen elements from a website. Even it creates a fictional flow. For example, clicking the “Online Banking” link will not redirect the user to the login page. But it can be a good start to understanding test scenarios and helping software testers write test scenarios.

Because the first experiment only results in a positive scenario, now for the second experiment, I’ll have chatGPT create a negative test scenario. The prompt I’m using is “generate negative case scenario for website http://zero.webappsecurity.com/". And the result is shown in the attached image.

ChatGPT Result for a negative scenario

The results are not quite different from the first result. But it was too focused on logging in.

 

Create a test scenario for the login page

For the third experiment, I will do something different. This time I’ll have chatGPT create a test scenario for the login page.

Zero bank login page

The prompt I’m using is “generate test case scenario for http://zero.webappsecurity.com/login.html".

Test scenario result for login page

ChatGPT is quite complete in making Test Scenarios. However, there are a few things to note:

  1. The scenario that is made is still limited to what appears on the screen. Not yet accommodate invisible flows, such as; failing to log in many times, logging in with saved cache, successfully login in then clicking the back button, etc.
  2. Create its fictitious pages. There is no “account summary page” page, let alone the contents of “account balance” and “transaction history”.
  3. The “Sign Up” button also doesn’t exist, let alone the “Sign Up page”.

Create a test scenario in cucumber

Then I have it to create a test scenario in cucumber.

Test scenario result for cucumber

Again, the result is very basic, even though it gives a disclaimer about it. But it can serve as a good template for testers to create test scenarios in cucumber.

Create a test script in Cypress

For the next experiment, I go further by having it create a cypress script.

Cypress script result

I even try to produce the cypress script using a different prompt, and here is the result.

Cypress script another result

From the result, we’ll know that chatGPT only produce an example script and didn’t get the actual element. It needs a lot of tweaking for the script to work properly.

Then BOOM!!! It can’t handle it anymore.

error

So, I guess this is the end of my experiment. I already have a lot of fun doing it, and maybe will do it again in the future.

How to use AI to make an article

Copy AI

 

 

Conclusion

ChatGPT can create good, systematic test scenarios. Although the scenario is pretty basic and only covers seen elements, it can serve as a good start to creating the actual scenarios.

It needs a lot of adjustment to actually work properly with our software.

It can’t do the essential work of a software tester, which is to run the test.

Connect with me

Krisnawan: Twitter | Linkedin | Medium

MydoQA: Twitter | Blog | Instagram | Facebook

Software Testing Process

, ,

 

The image consists of “Test Process fundamental” text. Picture of man and woman and a gear, illustrating a process.
Software Testing Process

Introduction

Software testing is the process of evaluating a software system or its components to find defects and assess the quality of the product. It is an integral part of the software development process, as it helps ensure that the developed product meets the specified requirements and is fit for its intended purpose.

Since we can agree on the importance of software testing, we may agree that software testing requires a set of activities to achieve its established objectives. This set of software testing activities is called the software testing process.

The decision about the proper and specific software testing process will depend on several contextual factors. Those contextual factors include, but are not limited to:

  • Software development lifecycle model and project methodologies being used
  • Test levels and test types being considered
  • Product and project risks
  • Business domain
  • Operational constraints, including but not limited to:
    — Budgets and resources
    — Timescales
    — Complexity
    — Contractual and regulatory requirements
  • Organizational policies and practices
  • Required internal and external standards

lambdatest

Test Activities and Tasks

Image of a hand holding a pen creating planning in a white paper
Photo by Kelly Sikkema on Unsplash

Test planning and control

In test planning, we specify the objectives of our testing, as well as the approach for meeting those objectives within constraints imposed by our context (e.g., specifying suitable techniques and tasks for testing). We may revisit these plans based on feedback from monitoring and control activities.

Management of any activity doesn’t stop with planning, there is more to it. For example, we need to control and measure progress against the plan. This is called test control and it is an ongoing activity. We need to compare actual progress against the planned progress and report to the project manager and customer on the current status of testing, including any changes or deviations from the plan.

Image of a gadget screen with “design” text
Photo by Edho Pratama on Unsplash

Test analysis and design

The activity of test analysis and design involves transforming general testing objectives into specific test conditions, as well as creating designs for those conditions.

During the test analysis phase, we analyze the test basis and define associated test conditions. In other words, we determine “what to test” in terms of measurable coverage criteria.

During test design, high-level test cases and sets of high-level test cases are created. These are used to answer the question “how to test?” while test analysis answers the question “what to test?”

Image of someone implementing design in a laptop
Photo by ThisisEngineering RAEng on Unsplash

Test implementation and execution

During the implementation and execution phase, we build a high-level design for our tests by transforming test conditions into test cases and procedures. So, test implementation addresses the question “Have we built everything we need to run our tests?”.

We also need to set up an environment where we will run the tests, build our test data and generate reports. Setting up environments and data often involves significant time and effort, so you should plan and monitor this work carefully.

Image with “exit” text
Photo by Dustin Tramel on Unsplash

Evaluating exit criteria and reporting

Evaluating exit criteria is a way to assess your testing activities against the defined objectives. Every test level needs to be evaluated against its objectives to see if it has met the requirements. This can be done for each project by looking at coverage and completion, acceptance, and process exit criteria.

Coverage and completion tell us how complete the tests are and how many cases must be tested for a given functionality.

Acceptance criteria tell us how we know whether the software has passed or failed overall and may include items such as checking that a system works as expected or that it meets all design standards.

Process exit criteria tell us whether we have completed all the tasks we need to do.

Image with “closed” text
Photo by Tim Mossholder on Unsplash

Test closure activities

During the closure of a test phase, we collect information from the completed activities to consolidate experience and check our knowledge. We might need to do this when the software is delivered or when testing has finished. We also might close testing for other reasons, such as when we have gathered all the information needed from testing, when a particular milestone has been achieved, when a project is canceled, or when an update or maintenance release is done.

Conclusion

Those testing process activities can be implemented sequentially, but for different occasions, they may overlap, take place concurrently, and often be implemented iteratively.

The software testing process is a crucial set of test activities in software testing as it helps ensure that the test objectives are achieved.

How to use AI to make an article

Copy AI

 

Connect with me

Krisnawan: Twitter | Linkedin | Medium

MydoQA: Twitter | Blog | Instagram | Facebook

Functional vs Non-Functional Testing

,

 

In this article, I will talk about functional and non-functional testing, and how both of them complement each other.

The image contains sentence “Functional testing vs non-functional testing”, two personal computers, the monitors show: list, bug, gear, gauge, cloud, and graphic.
Functional vs non-functional testing

What is?

Functional testing is a type of software testing that focuses on the user’s experience with the application. It’s usually performed by manually executing the application to determine whether or not it meets the functional requirements.

Functional testing is performed using the functional specification provided by the client and verifies the system against the functional requirements. Functional testing is executed first, using manual testing or automation tools.

Business requirements are the inputs to functional testing. Functional testers ensure that products work as intended by verifying that they meet all business requirements as defined in specifications and user stories.

“Functional testing is testing that the software works as it should. Testing that the design and requirement specifications have been met. We test the application from the perspective of the end-user.” ~ Ozan İlhan

Non-functional testing is the process of performing a test against a product, software, or system, for its non-functional requirements.

Non-functional tests are often performed after functional testing and can include things like performance, reliability, scalability, and other non-functional aspects of the system. It can give insights into how well the product works. Using the right tools will be effective for this testing.

Performance parameters like speed and scalability are goals for non-functional testing. Performance parameters also influence user experience. For example, if a website takes 1 min to load then users might not find it acceptable and leave it immediately or they might wait for a while before leaving only to find out that their site was down because of heavy traffic or something else but they had no way to know that until they tried to use it. This type of information is important for designers so they know what kind of performance they need in their products.

“Non-Functional testing is concerned with the non-functional requirements and is designed specifically to evaluate the readiness of a system according to the various criteria which are not covered by functional testing.”~ Ozan İlhan

Testing Type

Examples of Functional testing are

  • Unit Testing
  • Smoke Testing
  • Sanity Testing
  • Integration Testing
  • White box testing
  • Black Box testing
  • User Acceptance testing
  • Regression Testing

Examples of Non-functional testing are

  • Performance Testing
  • Load Testing
  • Volume Testing
  • Stress Testing
  • Security Testing
  • Installation Testing
  • Penetration Testing
  • Compatibility Testing
  • Migration Testing

Conclusion

Even though both types of testing serve different purposes, it can be said that both types of testing are complementing each other and can be integral parts of the whole software testing activities. Functional testing focuses the testing on the functional requirement of the software. Meanwhile, non-functional testing focuses on the different requirements of the software like performance, reliability, scalability, and other non-functional aspects of the system.

Connect with me

Krisnawan: Twitter | Linkedin | Medium

MydoQA: Twitter | Blog | Instagram | Facebook

Find this blog interesting? Follow us

About Me

My photo
Hello, I'm a professional software quality assurance and I like to share my enthusiasm.