{"id":296971,"date":"2018-01-26T05:00:00","date_gmt":"2018-01-26T05:00:00","guid":{"rendered":"https:\/\/integralads.com\/insider\/mastering-test-management\/"},"modified":"2023-07-12T11:51:57","modified_gmt":"2023-07-12T11:51:57","slug":"mastering-test-management","status":"publish","type":"post","link":"https:\/\/integralads.com\/apac\/insider\/mastering-test-management\/","title":{"rendered":"How we\u2019re mastering test management"},"content":{"rendered":"

For a lot of developers testing can be seen as a black box, something to be ignored until problems arise. For too many, the time to think about testing is the first time an exasperated manager asks, \u201cwasn\u2019t this tested?\u201d But quality isn\u2019t just a problem for the QA team. It\u2019s the responsibility of everyone involved in a project to ensure that the product that ships is as free of flaws and bugs as possible. The more people who participate in the review process the more valuable feedback we receive on scenarios that should be tested and functional areas that are no longer valid. <\/span><\/p>\n

The purpose of this article is to explore the Test Management process and to help you decide on a tool to help facilitate it. \u00a0First, we\u2019ll explore some of the common methods used to manage testing. Then we\u2019ll lay out the test management process that the IAS team has found most effective. <\/span><\/p>\n

    \n
  1. The human touch<\/b><\/li>\n<\/ol>\n

    All too often teams look to their most experienced members, the people who know the ins and outs of a particular project, to catch any major quality problems. We trust these subject matter experts to execute whatever ad-hoc testing plan they think is appropriate. This could include a mix of manual and automated tests, but the driving force behind this process is the expert’s experience rather than any sort of repeatable set of values or standards. Relying on experience might seem like a safe bet if you want to move quickly, but without a way to systematically capture and share this knowledge such a system leaves you highly vulnerable to breakdowns due to an unexpected departure, an extended vacation, or plain old human error. <\/span><\/p>\n

      \n
    1. The Post-It Note Approach <\/b><\/li>\n<\/ol>\n

      In some cases, teams might rely on \u00a0\u201cPost-Its,\u201d digital or even physical reminders detailing the things that need to be done to make a product ready for the customer. The danger with this approach is that with a large fast-moving team there is a high likelihood that these documents may not be kept up to date or reflect the latest changes. \u00a0Let alone shared with others. If these digital Post-Its are stored on local machines then all of the test details could be lost should something happen to that machine. A shareable document could solve this problem, which still leaves the problem of maintaining an up-to-date record that accounts for test-runs per milestone. Ultimately this method still falls short on capturing all test scenarios in an accurate, readable, and repeatable way. <\/span><\/p>\n

      Our Solution <\/b><\/p>\n

      To crack this problem, we evaluated a number of test management tools before we ultimately settled on TestRail. TestRail has REST API integration through which we can create our automation tests and add annotations in such a way that it automatically creates the test cases in TestRail when the pull request in Github is merged. \u00a0Another <\/span>key point is that we have the ability to use the TestRail API to auto-generated reports from test runs, which can prove useful when sharing with others.<\/span><\/p>\n

      Now, of course, a tool by itself won\u2019t be a silver bullet to fix test management. It helps to organize what you put in. I have seen cases where tests were written in a BDD format (i.e. GIVEN – WHEN – THEN). The problem of simply writing tests in any BDD framework<\/span> is that it is text that is written independently from the code. \u00a0This needs to be maintained or else it can quickly go out of date. \u00a0<\/span><\/p>\n

      First, we have manually added annotations to indicate what each step does and that has been successfully added into TestRail with API integration. \u00a0Second, we plan to focus on the <\/span>Python component tests that are written with a highly readable set of clauses. We can mark lines in our DSL as @documented and what this does is build a line-by-line description of the test as each DSL function is executed. <\/span><\/p>\n

      At the moment we are trying to build a POC that builds the test description automatically but it is not plugged into the TestRail API yet. \u00a0It can also take any parameters passed to a DSL function via parameterized test annotations and generate a specific test description for each. But at the end of the day, it’s not dissimilar to other BDD frameworks in that you get a humanly readable report as output. <\/span><\/p>\n

      We are very close to a streamlined test management process that doesn\u2019t rely on individual team members or a massive running list of tasks and results. Using TestRail we are creating a process that allows the entire team to contribute to the overall quality of the product while cutting down on human error and without adding a ton of additional tracking work to anyone\u2019s plate. <\/span><\/span><\/span><\/span><\/span><\/p>\n","protected":false},"excerpt":{"rendered":"

      We explore some of the common methods used to manage testing and lay out the test management process that the IAS team has found most effective.<\/p>\n","protected":false},"author":1,"featured_media":296972,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[218],"tags":[],"class_list":["post-296971","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-insights-apac"],"acf":[],"yoast_head":"\nHow we\u2019re mastering test management - Integral Ad Science<\/title>\n<meta name=\"description\" content=\"We explore some of the common methods used to manage testing and lay out the test management process that the IAS team has found most effective.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/integralads.com\/apac\/insider\/mastering-test-management\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"How we\u2019re mastering test management\" \/>\n<meta property=\"og:description\" content=\"We explore some of the common methods used to manage testing and lay out the test management process that the IAS team has found most effective.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/integralads.com\/apac\/insider\/mastering-test-management\/\" \/>\n<meta property=\"og:site_name\" content=\"Integral Ad Science\" \/>\n<meta property=\"article:published_time\" content=\"2018-01-26T05:00:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-07-12T11:51:57+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/integralads.com\/wp-content\/uploads\/2023\/06\/post-it-wall-760-760-1.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"760\" \/>\n\t<meta property=\"og:image:height\" content=\"760\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"IAS TEAM\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@integralads\" \/>\n<meta name=\"twitter:site\" content=\"@integralads\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"IAS TEAM\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/integralads.com\/apac\/insider\/mastering-test-management\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/integralads.com\/apac\/insider\/mastering-test-management\/\"},\"author\":{\"name\":\"IAS TEAM\",\"@id\":\"https:\/\/integralads.com\/#\/schema\/person\/dbee79df007713b5bab3127e3f349399\"},\"headline\":\"How we\u2019re mastering test management\",\"datePublished\":\"2018-01-26T05:00:00+00:00\",\"dateModified\":\"2023-07-12T11:51:57+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/integralads.com\/apac\/insider\/mastering-test-management\/\"},\"wordCount\":804,\"publisher\":{\"@id\":\"https:\/\/integralads.com\/#organization\"},\"image\":{\"@id\":\"https:\/\/integralads.com\/apac\/insider\/mastering-test-management\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/integralads.com\/wp-content\/uploads\/2023\/06\/post-it-wall-760-760-1.jpg\",\"articleSection\":[\"Insights\"],\"inLanguage\":\"en-APAC\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/integralads.com\/apac\/insider\/mastering-test-management\/\",\"url\":\"https:\/\/integralads.com\/apac\/insider\/mastering-test-management\/\",\"name\":\"How we\u2019re mastering test management - Integral Ad Science\",\"isPartOf\":{\"@id\":\"https:\/\/integralads.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/integralads.com\/apac\/insider\/mastering-test-management\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/integralads.com\/apac\/insider\/mastering-test-management\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/integralads.com\/wp-content\/uploads\/2023\/06\/post-it-wall-760-760-1.jpg\",\"datePublished\":\"2018-01-26T05:00:00+00:00\",\"dateModified\":\"2023-07-12T11:51:57+00:00\",\"description\":\"We explore some of the common methods used to manage testing and lay out the test management process that the IAS team has found most effective.\",\"breadcrumb\":{\"@id\":\"https:\/\/integralads.com\/apac\/insider\/mastering-test-management\/#breadcrumb\"},\"inLanguage\":\"en-APAC\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/integralads.com\/apac\/insider\/mastering-test-management\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-APAC\",\"@id\":\"https:\/\/integralads.com\/apac\/insider\/mastering-test-management\/#primaryimage\",\"url\":\"https:\/\/integralads.com\/wp-content\/uploads\/2023\/06\/post-it-wall-760-760-1.jpg\",\"contentUrl\":\"https:\/\/integralads.com\/wp-content\/uploads\/2023\/06\/post-it-wall-760-760-1.jpg\",\"width\":760,\"height\":760},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/integralads.com\/apac\/insider\/mastering-test-management\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/integralads.com\/apac\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"How we\u2019re mastering test management\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/integralads.com\/#website\",\"url\":\"https:\/\/integralads.com\/\",\"name\":\"Integral Ad Science\",\"description\":\"The Hidden Cost of MFA Webinar\",\"publisher\":{\"@id\":\"https:\/\/integralads.com\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/integralads.com\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-APAC\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/integralads.com\/#organization\",\"name\":\"Integral Ad Science\",\"url\":\"https:\/\/integralads.com\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-APAC\",\"@id\":\"https:\/\/integralads.com\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/integralads.com\/wp-content\/uploads\/2023\/10\/IAS_Square-Logo-600x600-1.png\",\"contentUrl\":\"https:\/\/integralads.com\/wp-content\/uploads\/2023\/10\/IAS_Square-Logo-600x600-1.png\",\"width\":600,\"height\":600,\"caption\":\"Integral Ad Science\"},\"image\":{\"@id\":\"https:\/\/integralads.com\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/x.com\/integralads\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/integralads.com\/#\/schema\/person\/dbee79df007713b5bab3127e3f349399\",\"name\":\"IAS TEAM\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-APAC\",\"@id\":\"https:\/\/integralads.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/255e04bda9c08f76d15834db86e6d973bed5d92c701c65e4e3781e74f8b79551?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/255e04bda9c08f76d15834db86e6d973bed5d92c701c65e4e3781e74f8b79551?s=96&d=mm&r=g\",\"caption\":\"IAS TEAM\"},\"description\":\"Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum.\",\"sameAs\":[\"https:\/\/integralads.com\"],\"jobTitle\":\"TEST\",\"url\":\"https:\/\/integralads.com\/apac\/insider\/author\/ias2023\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"How we\u2019re mastering test management - Integral Ad Science","description":"We explore some of the common methods used to manage testing and lay out the test management process that the IAS team has found most effective.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/integralads.com\/apac\/insider\/mastering-test-management\/","og_locale":"en_US","og_type":"article","og_title":"How we\u2019re mastering test management","og_description":"We explore some of the common methods used to manage testing and lay out the test management process that the IAS team has found most effective.","og_url":"https:\/\/integralads.com\/apac\/insider\/mastering-test-management\/","og_site_name":"Integral Ad Science","article_published_time":"2018-01-26T05:00:00+00:00","article_modified_time":"2023-07-12T11:51:57+00:00","og_image":[{"width":760,"height":760,"url":"https:\/\/integralads.com\/wp-content\/uploads\/2023\/06\/post-it-wall-760-760-1.jpg","type":"image\/jpeg"}],"author":"IAS TEAM","twitter_card":"summary_large_image","twitter_creator":"@integralads","twitter_site":"@integralads","twitter_misc":{"Written by":"IAS TEAM","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/integralads.com\/apac\/insider\/mastering-test-management\/#article","isPartOf":{"@id":"https:\/\/integralads.com\/apac\/insider\/mastering-test-management\/"},"author":{"name":"IAS TEAM","@id":"https:\/\/integralads.com\/#\/schema\/person\/dbee79df007713b5bab3127e3f349399"},"headline":"How we\u2019re mastering test management","datePublished":"2018-01-26T05:00:00+00:00","dateModified":"2023-07-12T11:51:57+00:00","mainEntityOfPage":{"@id":"https:\/\/integralads.com\/apac\/insider\/mastering-test-management\/"},"wordCount":804,"publisher":{"@id":"https:\/\/integralads.com\/#organization"},"image":{"@id":"https:\/\/integralads.com\/apac\/insider\/mastering-test-management\/#primaryimage"},"thumbnailUrl":"https:\/\/integralads.com\/wp-content\/uploads\/2023\/06\/post-it-wall-760-760-1.jpg","articleSection":["Insights"],"inLanguage":"en-APAC"},{"@type":"WebPage","@id":"https:\/\/integralads.com\/apac\/insider\/mastering-test-management\/","url":"https:\/\/integralads.com\/apac\/insider\/mastering-test-management\/","name":"How we\u2019re mastering test management - Integral Ad Science","isPartOf":{"@id":"https:\/\/integralads.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/integralads.com\/apac\/insider\/mastering-test-management\/#primaryimage"},"image":{"@id":"https:\/\/integralads.com\/apac\/insider\/mastering-test-management\/#primaryimage"},"thumbnailUrl":"https:\/\/integralads.com\/wp-content\/uploads\/2023\/06\/post-it-wall-760-760-1.jpg","datePublished":"2018-01-26T05:00:00+00:00","dateModified":"2023-07-12T11:51:57+00:00","description":"We explore some of the common methods used to manage testing and lay out the test management process that the IAS team has found most effective.","breadcrumb":{"@id":"https:\/\/integralads.com\/apac\/insider\/mastering-test-management\/#breadcrumb"},"inLanguage":"en-APAC","potentialAction":[{"@type":"ReadAction","target":["https:\/\/integralads.com\/apac\/insider\/mastering-test-management\/"]}]},{"@type":"ImageObject","inLanguage":"en-APAC","@id":"https:\/\/integralads.com\/apac\/insider\/mastering-test-management\/#primaryimage","url":"https:\/\/integralads.com\/wp-content\/uploads\/2023\/06\/post-it-wall-760-760-1.jpg","contentUrl":"https:\/\/integralads.com\/wp-content\/uploads\/2023\/06\/post-it-wall-760-760-1.jpg","width":760,"height":760},{"@type":"BreadcrumbList","@id":"https:\/\/integralads.com\/apac\/insider\/mastering-test-management\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/integralads.com\/apac\/"},{"@type":"ListItem","position":2,"name":"How we\u2019re mastering test management"}]},{"@type":"WebSite","@id":"https:\/\/integralads.com\/#website","url":"https:\/\/integralads.com\/","name":"Integral Ad Science","description":"The Hidden Cost of MFA Webinar","publisher":{"@id":"https:\/\/integralads.com\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/integralads.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-APAC"},{"@type":"Organization","@id":"https:\/\/integralads.com\/#organization","name":"Integral Ad Science","url":"https:\/\/integralads.com\/","logo":{"@type":"ImageObject","inLanguage":"en-APAC","@id":"https:\/\/integralads.com\/#\/schema\/logo\/image\/","url":"https:\/\/integralads.com\/wp-content\/uploads\/2023\/10\/IAS_Square-Logo-600x600-1.png","contentUrl":"https:\/\/integralads.com\/wp-content\/uploads\/2023\/10\/IAS_Square-Logo-600x600-1.png","width":600,"height":600,"caption":"Integral Ad Science"},"image":{"@id":"https:\/\/integralads.com\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/x.com\/integralads"]},{"@type":"Person","@id":"https:\/\/integralads.com\/#\/schema\/person\/dbee79df007713b5bab3127e3f349399","name":"IAS TEAM","image":{"@type":"ImageObject","inLanguage":"en-APAC","@id":"https:\/\/integralads.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/255e04bda9c08f76d15834db86e6d973bed5d92c701c65e4e3781e74f8b79551?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/255e04bda9c08f76d15834db86e6d973bed5d92c701c65e4e3781e74f8b79551?s=96&d=mm&r=g","caption":"IAS TEAM"},"description":"Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum.","sameAs":["https:\/\/integralads.com"],"jobTitle":"TEST","url":"https:\/\/integralads.com\/apac\/insider\/author\/ias2023\/"}]}},"_links":{"self":[{"href":"https:\/\/integralads.com\/apac\/wp-json\/wp\/v2\/posts\/296971","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/integralads.com\/apac\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/integralads.com\/apac\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/integralads.com\/apac\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/integralads.com\/apac\/wp-json\/wp\/v2\/comments?post=296971"}],"version-history":[{"count":0,"href":"https:\/\/integralads.com\/apac\/wp-json\/wp\/v2\/posts\/296971\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/integralads.com\/apac\/wp-json\/wp\/v2\/media\/296972"}],"wp:attachment":[{"href":"https:\/\/integralads.com\/apac\/wp-json\/wp\/v2\/media?parent=296971"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/integralads.com\/apac\/wp-json\/wp\/v2\/categories?post=296971"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/integralads.com\/apac\/wp-json\/wp\/v2\/tags?post=296971"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}