Edit Job File

CXTM Test Automation

Introduction
CXTM Basics
CXTM Projects
CXTM Test Cases
CXTM Test Automation
Revisit Imported Test Cases
CXTM Batches
CXTM Notifications
NetDevOps
CXTM Reporting
CXTM References
Bonus: Project Users
Bonus: CXTM REST API
Bonus: Secret Env Variables

Edit Job File

Now that you have successfully developed the automation to verify the software version on one device, you will edit the test case to verify the software version on all the devices in your test bed.

Step 1 - Return to the Job File editor

From the Job File page:

Click on the pencil icon in the upper right-hand corner of the Job File Preview pane to return to the editor

Step 2 - Edit the Connect to Devices step to iterate over devices

In order to connect to all the devices in your testbed, you will just need to make a few simple changes to the Connect to Devices step in your Job File. First, you will wrap the code in a FOR loop to iterate over a list of devices.

Secondly, since you will need to change the DEVICES var to a list in the next step, you will need to ensure that the DEVICES var used in the FOR loop uses the correct Robot Framework variable syntax of @{DEVICES}, prefaced with an "@" sign for a list rather than the syntax of ${DEVICES}, prefaced with a "$" sign for scalar variables.

    
*** Test Cases ***
1. CONNECT TO DEVICES
    FOR  ${DEVICE}  IN  @{DEVICES}
        ${status}=  Run Keyword And Ignore Error  connect to device "${DEVICE}"
        IF  '${status[0]}' == 'FAIL'
            Fail  ++UNSUCCESSFUL++ ${DEVICE} not connected
        ELSE
            set test message  ++SUCCESSFUL++ ${DEVICE} connected \n  append=True
        END
    END

In the Script Text editor:

Replace lines 17-22 in your Job File with the code in lines 17-24 below

    
*** Settings ***
Library  CXTA
Resource  cxta.robot

Library  BuiltIn
Library  Collections

Suite Setup         Run Keywords
...                 load testbed

Suite Teardown      Run Keywords
...                 Disconnect From All Devices

*** Test Cases ***
1. CONNECT TO DEVICES
    FOR  ${DEVICE}  IN  @{DEVICES}
        ${status}=  Run Keyword And Ignore Error  connect to device "${DEVICE}"
        IF  '${status[0]}' == 'FAIL'
            Fail  ++UNSUCCESSFUL++ ${DEVICE} not connected
        ELSE
            set test message  ++SUCCESSFUL++ ${DEVICE} connected \n  append=True
        END
    END

2. VERIFY SOFTWARE VERSION
    ${VERSION_OUTPUT}=  parse "show version" on device "${DEVICES}"
    ${CFG_VERSION}=  Get From Dictionary  ${VERSION_OUTPUT['version']}  version
    ${status}=  Run Keyword And Return Status  should be true  '${CFG_VERSION}' == '${EXP_XE_8K_VERSION}'
    IF  '${status}' == 'False'
        Fail  ++UNSUCCESSFUL++ Device ${DEVICES} is not running the expected version ${EXP_XE_8K_VERSION}
    ELSE
        set test message  ++SUCCESSFUL++ ${DEVICES} is running the expected version ${CFG_VERSION}\n  append=True
    END

Step 3 - Change the DEVICES variable to a list of devices

As the Parameter File is a YAML file, you will use YAML syntax to define the list, as in the following example.

In the Parameter File editor:

Replace line 1 in your Parameter File with the code in lines 1-5 below

    
DEVICES:
    - C8Kv-01
    - CSR1Kv-01
    - XR9Kv-01
    - N9Kv-01

EXP_XE_8K_VERSION:  17.12.2

Step 4 - Edit the Verify Software Versions step to iterate over devices

Your testbed devices are running 4 different software versions on 3 different Cisco operating systems, so editing this procedure to iterate over all the devices in your testbed and verify that they are all running the expected software version will require a bit more logic than the previous step.

First, as in the step above, you will add a FOR loop to iterate over the devices. Second, you will add logic to conditionally execute keywords based on device attributes that you already provided when creating your device inventory on the Devices page.

Beginning on line 27 of your Job File, delete your code and replace it with the highlighted code below to add a FOR loop

    
*** Settings ***
Library  CXTA
Resource  cxta.robot

Library  BuiltIn
Library  Collections

Suite Setup         Run Keywords
...                 load testbed

Suite Teardown      Run Keywords
...                 Disconnect From All Devices

*** Test Cases ***
1. CONNECT TO DEVICES
    FOR  ${DEVICE}  IN  @{DEVICES}
        ${status}=  Run Keyword And Ignore Error  connect to device "${DEVICE}"
        IF  '${status[0]}' == 'FAIL'
            Fail  ++UNSUCCESSFUL++ ${DEVICE} not connected
        ELSE
            set test message  ++SUCCESSFUL++ ${DEVICE} connected \n  append=True
        END
    END

2. VERIFY SOFTWARE VERSION
    FOR  ${DEVICE}  IN  @{DEVICES}

You already changed the DEVICES variable to a list of devices in the previous step, so there's no need for any further modifications to the Parameter File yet.

In the nex steps, you will add code to conditionally execute keywords and verify software versions based on the device OS (e.g. IOS-XE vs IOS-XR vs NXOS) and device type (e.g. C8Kv vs CSR1Kv) in your testbed topology. The assumption made here is that the devices in the testbed are running the expected software versions according to each device's OS, platform, role, etc, as defined in a hypothetical network deployment plan. (e.g. the hypothetical deployment plan in this example dictates that a newly inserted C8Kv device should be running IOS-XE version 17.12.2).

The testbed topology in this lab is intentionally small and simple to illustrate concepts. Your own staging environment may be comparatively larger and more complex, but the same logic could apply to conditionally execute the appropriate procedures based on your own device inventory.

Step 5 - Edit the Verify Software Versions step to get testbed attributes

Recall the topology file that you previewed earlier in the lab after adding your devices to the Devices page, and the attributes associated with each device.

    
testbed:
    name: ltrops2711
devices:
<snip>
    C8Kv-01:
    type: router
    connections:
        ssh:
        protocol: ssh
        ip: 10.15.103.12
        username: admin
        password: cisco.123
        class: unicon.Unicon
    defaults:
        via: ssh
    os: iosxe
<snip>

Add the following code to line 28 of your Job File

    
*** Settings ***
Library  CXTA
Resource  cxta.robot

Library  BuiltIn
Library  Collections

Suite Setup         Run Keywords
...                 load testbed

Suite Teardown      Run Keywords
...                 Disconnect From All Devices

*** Test Cases ***
1. CONNECT TO DEVICES
    FOR  ${DEVICE}  IN  @{DEVICES}
        ${status}=  Run Keyword And Ignore Error  connect to device "${DEVICE}"
        IF  '${status[0]}' == 'FAIL'
            Fail  ++UNSUCCESSFUL++ ${DEVICE} not connected
        ELSE
            set test message  ++SUCCESSFUL++ ${DEVICE} connected \n  append=True
        END
    END

2. VERIFY SOFTWARE VERSION
    FOR  ${DEVICE}  IN  @{DEVICES}
        ${os}=    from testbed devices get "${DEVICE}.os"

This step introduces a new keyword. The from testbed devices get "${attr}" keyword from the CXTA.robot.Testbed library gets a specific attribute from the devices in the testbed, based on the attribute key passed to it. The value for the os attribute is fetched in this example, and stored in a local variable for use in subsequent procedures.

Step 6 - Add conditional logic for IOS-XE C8Kv devices

You will be able to reuse the code you developed earlier when verifying the software version on a single IOS-XE device, only now you will nest it within IF-ELSE logic.

You have already used IF-ELSE statements to conditionally set test messages based on a returned status. Next, you will use them to conditionally execute code based on the device attributes fetched from your topology file. This is necessary because the parser schema is different for each operating system, and the correct parser key for the operating system must be used. Also, each device in your testbed is running a different version of software, so different variables are used in this example.

Add the following highlighted code to lines 29-38 of your Job File

    
*** Settings ***
Library  CXTA
Resource  cxta.robot

Library  BuiltIn
Library  Collections

Suite Setup         Run Keywords
...                 load testbed

Suite Teardown      Run Keywords
...                 Disconnect From All Devices

*** Test Cases ***
1. CONNECT TO DEVICES
    FOR  ${DEVICE}  IN  @{DEVICES}
        ${status}=  Run Keyword And Ignore Error  connect to device "${DEVICE}"
        IF  '${status[0]}' == 'FAIL'
            Fail  ++UNSUCCESSFUL++ ${DEVICE} not connected
        ELSE
            set test message  ++SUCCESSFUL++ ${DEVICE} connected \n  append=True
        END
    END

2. VERIFY SOFTWARE VERSION
    FOR  ${DEVICE}  IN  @{DEVICES}
        ${os}=    from testbed devices get "${DEVICE}.os"
        IF    "${os}" == "iosxe" and "8K" in "${DEVICE}"
            select device "${DEVICE}"
            ${VERSION_OUTPUT}=  parse "show version" on device "${DEVICE}"
            ${CFG_VERSION}=  Get From Dictionary  ${VERSION_OUTPUT['version']}  version
            ${status}=  Run Keyword And Return Status  should be true  '${CFG_VERSION}' == '${EXP_XE_8K_VERSION}'
            IF  '${status}' == 'False'
                Fail  ++UNSUCCESSFUL++ Device ${DEVICE} is not running the expected version ${EXP_XE_8K_VERSION}
            ELSE
                set test message  ++SUCCESSFUL++ ${DEVICE} is running the expected version ${CFG_VERSION}\n  append=True
            END

Step 7 - Add conditional logic for IOS-XE CSR1Kv devices

In the previous step, you added conditional logic to execute code if the os equals "iosxe" and the device hostname includes "8K". Next, you will add conditional logic to execute code for IOS-XE CSR1Kv devices.

Add the following highlighted code to lines 39-48 of your Job File

    
*** Settings ***
Library  CXTA
Resource  cxta.robot

Library  BuiltIn
Library  Collections

Suite Setup         Run Keywords
...                 load testbed

Suite Teardown      Run Keywords
...                 Disconnect From All Devices

*** Test Cases ***
1. CONNECT TO DEVICES
    FOR  ${DEVICE}  IN  @{DEVICES}
        ${status}=  Run Keyword And Ignore Error  connect to device "${DEVICE}"
        IF  '${status[0]}' == 'FAIL'
            Fail  ++UNSUCCESSFUL++ ${DEVICE} not connected
        ELSE
            set test message  ++SUCCESSFUL++ ${DEVICE} connected \n  append=True
        END
    END

2. VERIFY SOFTWARE VERSION
    FOR  ${DEVICE}  IN  @{DEVICES}
        ${os}=    from testbed devices get "${DEVICE}.os"
        IF    "${os}" == "iosxe" and "8K" in "${DEVICE}"
            select device "${DEVICE}"
            ${VERSION_OUTPUT}=  parse "show version" on device "${DEVICE}"
            ${CFG_VERSION}=  Get From Dictionary  ${VERSION_OUTPUT['version']}  version
            ${status}=  Run Keyword And Return Status  should be true  '${CFG_VERSION}' == '${EXP_XE_8K_VERSION}'
            IF  '${status}' == 'False'
                Fail  ++UNSUCCESSFUL++ Device ${DEVICE} is not running the expected version ${EXP_XE_8K_VERSION}
            ELSE
                set test message  ++SUCCESSFUL++ ${DEVICE} is running the expected version ${CFG_VERSION}\n  append=True
            END 
        ELSE IF    "${os}" == "iosxe" and "1K" in "${DEVICE}"
            select device "${DEVICE}"
            ${VERSION_OUTPUT}=  parse "show version" on device "${DEVICE}"
            ${CFG_VERSION}=  Get From Dictionary  ${VERSION_OUTPUT['version']}  version
            ${status}=  Run Keyword And Return Status  should be true  '${CFG_VERSION}' == '${EXP_XE_1K_VERSION}'
            IF  '${status}' == 'False'
                Fail  ++UNSUCCESSFUL++ Device ${DEVICE} is not running the expected version ${EXP_XE_1K_VERSION}
            ELSE
                set test message  ++SUCCESSFUL++ ${DEVICE} is running the expected version ${CFG_VERSION}\n  append=True
            END

There are only three minor changes in this code, relative to the last step. First, notice the ELSE IF in line 39. ELSE IF branches are evaluated in the order in which they are coded in the Job File, and their conditions are evaluated if preceding conditions are not true. The block of code following the ELSE IF will be executed if the condition is true, ignoring any subsequent branches.

Second, the code has changed to check that "1K" is present in the device hostname to catch the CSR1Kv devices in your topology. Since the CSR1Kv device also runs IOS-XE, the parser schema is the same and does not need to change in this IF-ELSE branch.

And third, since the IOS-XE CSR1Kv devices run a different software version than the IOS-XE C8Kv devices in your topology, a new variable, EXP_XE_1K_VERSION, has been introduced. You'll define this variable in a later step.

Step 8 - Add conditional logic for IOS-XR devices

Next, you will add conditional logic to execute code for the IOS-XR routers in your topology.

Add the following highlighted code to lines 49-58 of your Job File

    
*** Settings ***
Library  CXTA
Resource  cxta.robot

Library  BuiltIn
Library  Collections

Suite Setup         Run Keywords
...                 load testbed

Suite Teardown      Run Keywords
...                 Disconnect From All Devices

*** Test Cases ***
1. CONNECT TO DEVICES
    FOR  ${DEVICE}  IN  @{DEVICES}
        ${status}=  Run Keyword And Ignore Error  connect to device "${DEVICE}"
        IF  '${status[0]}' == 'FAIL'
            Fail  ++UNSUCCESSFUL++ ${DEVICE} not connected
        ELSE
            set test message  ++SUCCESSFUL++ ${DEVICE} connected \n  append=True
        END
    END

2. VERIFY SOFTWARE VERSION
    FOR  ${DEVICE}  IN  @{DEVICES}
        ${os}=    from testbed devices get "${DEVICE}.os"
        IF    "${os}" == "iosxe" and "8K" in "${DEVICE}"
            select device "${DEVICE}"
            ${VERSION_OUTPUT}=  parse "show version" on device "${DEVICE}"
            ${CFG_VERSION}=  Get From Dictionary  ${VERSION_OUTPUT['version']}  version
            ${status}=  Run Keyword And Return Status  should be true  '${CFG_VERSION}' == '${EXP_XE_8K_VERSION}'
            IF  '${status}' == 'False'
                Fail  ++UNSUCCESSFUL++ Device ${DEVICE} is not running the expected version ${EXP_XE_8K_VERSION}
            ELSE
                set test message  ++SUCCESSFUL++ ${DEVICE} is running the expected version ${CFG_VERSION}\n  append=True
            END 
        ELSE IF    "${os}" == "iosxe" and "1K" in "${DEVICE}"
            select device "${DEVICE}"
            ${VERSION_OUTPUT}=  parse "show version" on device "${DEVICE}"
            ${CFG_VERSION}=  Get From Dictionary  ${VERSION_OUTPUT['version']}  version
            ${status}=  Run Keyword And Return Status  should be true  '${CFG_VERSION}' == '${EXP_XE_1K_VERSION}'
            IF  '${status}' == 'False'
                Fail  ++UNSUCCESSFUL++ Device ${DEVICE} is not running the expected version ${EXP_XE_1K_VERSION}
            ELSE
                set test message  ++SUCCESSFUL++ ${DEVICE} is running the expected version ${CFG_VERSION}\n  append=True
            END    
        ELSE IF    "${os}" == "iosxr"
            select device "${DEVICE}"
            ${VERSION_OUTPUT}=  parse "show version" on device "${DEVICE}"
            ${CFG_VERSION}=  Get From Dictionary  ${VERSION_OUTPUT}  software_version
            ${status}=  Run Keyword And Return Status  should be true  '${CFG_VERSION}' == '${EXP_XR_VERSION}'
            IF  '${status}' == 'False'
                Fail  ++UNSUCCESSFUL++ Device ${DEVICE} is not running the expected version ${EXP_XR_VERSION}
            ELSE
                set test message  ++SUCCESSFUL++ ${DEVICE} is running the expected version ${CFG_VERSION}\n  append=True
            END

Notice that the "os" attribute has been changed to "iosxr". Since there is only one IOS-XR device type in your topology, no additional criteria to identify the device type is needed in this step.

However, the key used to get the IOS-XR software version in the parser has changed in accordance with the published IOS-XR show version parser schema.

    
{
'operating_system': <class 'str'>,
'software_version': <class 'str'>,
'uptime': <class 'str'>,
Optional  (str) image: <class 'str'>,
Optional  (str) device_family: <class 'str'>,
Optional  (str) processor: <class 'str'>,
Optional  (str) processor_memory_bytes: <class 'str'>,
Optional  (str) chassis_detail: <class 'str'>,
Optional  (str) config_register: <class 'str'>,
Optional  (str) rp_config_register: <class 'str'>,
Optional  (str) main_mem: <class 'str'>,
Optional  (str) built_by: <class 'str'>,
Optional  (str) built_on: <class 'str'>,
Optional  (str) built_host: <class 'str'>,
}

Also, you have added a new variable for the expected IOS-XR version (EXP_XR_VERSION). You will define this variable in a later step.

Step 9 - Add conditional logic for NXOS devices

Finally, you will add conditional logic to execute code for the NXOS devices in your topology.

Add the following highlighted code to lines 59-70 of your Job File

    
*** Settings ***
Library  CXTA
Resource  cxta.robot

Library  BuiltIn
Library  Collections

Suite Setup         Run Keywords
...                 load testbed

Suite Teardown      Run Keywords
...                 Disconnect From All Devices

*** Test Cases ***
1. CONNECT TO DEVICES
    FOR  ${DEVICE}  IN  @{DEVICES}
        ${status}=  Run Keyword And Ignore Error  connect to device "${DEVICE}"
        IF  '${status[0]}' == 'FAIL'
            Fail  ++UNSUCCESSFUL++ ${DEVICE} not connected
        ELSE
            set test message  ++SUCCESSFUL++ ${DEVICE} connected \n  append=True
        END
    END

2. VERIFY SOFTWARE VERSION
    FOR  ${DEVICE}  IN  @{DEVICES}
        ${os}=    from testbed devices get "${DEVICE}.os"
        IF    "${os}" == "iosxe" and "8K" in "${DEVICE}"
            select device "${DEVICE}"
            ${VERSION_OUTPUT}=  parse "show version" on device "${DEVICE}"
            ${CFG_VERSION}=  Get From Dictionary  ${VERSION_OUTPUT['version']}  version
            ${status}=  Run Keyword And Return Status  should be true  '${CFG_VERSION}' == '${EXP_XE_8K_VERSION}'
            IF  '${status}' == 'False'
                Fail  ++UNSUCCESSFUL++ Device ${DEVICE} is not running the expected version ${EXP_XE_8K_VERSION}
            ELSE
                set test message  ++SUCCESSFUL++ ${DEVICE} is running the expected version ${CFG_VERSION}\n  append=True
            END 
        ELSE IF    "${os}" == "iosxe" and "1K" in "${DEVICE}"
            select device "${DEVICE}"
            ${VERSION_OUTPUT}=  parse "show version" on device "${DEVICE}"
            ${CFG_VERSION}=  Get From Dictionary  ${VERSION_OUTPUT['version']}  version
            ${status}=  Run Keyword And Return Status  should be true  '${CFG_VERSION}' == '${EXP_XE_1K_VERSION}'
            IF  '${status}' == 'False'
                Fail  ++UNSUCCESSFUL++ Device ${DEVICE} is not running the expected version ${EXP_XE_1K_VERSION}
            ELSE
                set test message  ++SUCCESSFUL++ ${DEVICE} is running the expected version ${CFG_VERSION}\n  append=True
            END    
        ELSE IF    "${os}" == "iosxr"
            select device "${DEVICE}"
            ${VERSION_OUTPUT}=  parse "show version" on device "${DEVICE}"
            ${CFG_VERSION}=  Get From Dictionary  ${VERSION_OUTPUT}  software_version
            ${status}=  Run Keyword And Return Status  should be true  '${CFG_VERSION}' == '${EXP_XR_VERSION}'
            IF  '${status}' == 'False'
                Fail  ++UNSUCCESSFUL++ Device ${DEVICE} is not running the expected version ${EXP_XR_VERSION}
            ELSE
                set test message  ++SUCCESSFUL++ ${DEVICE} is running the expected version ${CFG_VERSION}\n  append=True
            END      
        ELSE IF    "${os}" == "nxos"
            select device "${DEVICE}"
            ${VERSION_OUTPUT}=  parse "show version" on device "${DEVICE}"
            ${CFG_VERSION}=  Get From Dictionary  ${VERSION_OUTPUT['platform']['software']}  system_version
            ${status}=  Run Keyword And Return Status  should be true  '${CFG_VERSION}' == '${EXP_NXOS_VERSION}'
            IF  '${status}' == 'False'
                Fail  ++UNSUCCESSFUL++ Device ${DEVICE} is not running the expected version ${EXP_NXOS_VERSION}
            ELSE
                set test message  ++SUCCESSFUL++ ${DEVICE} is running the expected version ${CFG_VERSION}\n  append=True
            END
        END
    END

Notice that the "os" attribute has been changed to "nxos". Similarly to IOS-XR, since there is only one NXOS device type in your topology, an additional device type check is not needed in this step. Also like IOS-XR, NXOS has its own parser schema, so the key used to get the NXOS software version has changed in accordance with the published NXOS show version parser schema.

    
{
'platform': {
    <snip>
    },
    'software': {
    Optional  (str) bios_version: <class 'str'>,
    Optional  (str) bios_compile_time: <class 'str'>,
    Optional  (str) kickstart_version: <class 'str'>,
    Optional  (str) kickstart_compile_time: <class 'str'>,
    Optional  (str) kickstart_image_file: <class 'str'>,
    Optional  (str) system_version: <class 'str'>,
    Optional  (str) system_compile_time: <class 'str'>,
    Optional  (str) system_image_file: <class 'str'>,
    },
    },
}

Also, you have added a new variable for the expected NXOS version (EXP_NXOS_VERSION). You will define this variable, and the other new variables introduced above, in the next step.

Step 10 - Define the variables introduced in the last steps

In the Parameter File editor:

Add the following code to lines 8-10

    
DEVICES:
  - C8Kv-01
  - CSR1Kv-01
  - XR9Kv-01
  - N9Kv-01

EXP_XE_8K_VERSION:  17.12.2
EXP_XE_1K_VERSION:  17.3.8a
EXP_XR_VERSION:  7.4.1
EXP_NXOS_VERSION:  9.3(13)

Step 11 - Set the Default Topology to LTROPS-2711 Topology

While on the Job File Edit page:

Scroll down to the Advanced Settings section below the Parameter File editor
Select LTROPS-2711 Topology from the Default Topology dropdown

When you ran this test case on the on just the C8Kv-01 device in the previous section, the Default Topology was set to Generate topology at runtime by default, which generates a topology based on the devices on the Devices page. Since you will be rerunning this test case on all devices in the testbed, you will need to set the Default Topology to the LTROPS-2711 Topology, which includes all the devices you will be interfacing with in this lab.

Step 12 - Save and Run

Congratulations! You have added all of the procedures and variables needed to the run this test case.

Confirm that your Script Text and Parameter File match the following, and copy/paste the complete output if needed

    
*** Settings ***
Library  CXTA
Resource  cxta.robot

Library  BuiltIn
Library  Collections

Suite Setup         Run Keywords
...                 load testbed

Suite Teardown      Run Keywords
...                 Disconnect From All Devices

*** Test Cases ***
1. CONNECT TO DEVICES
    FOR  ${DEVICE}  IN  @{DEVICES}
        ${status}=  Run Keyword And Ignore Error  connect to device "${DEVICE}"
        IF  '${status[0]}' == 'FAIL'
            Fail  ++UNSUCCESSFUL++ ${DEVICE} not connected
        ELSE
            set test message  ++SUCCESSFUL++ ${DEVICE} connected \n  append=True
        END
    END

2. VERIFY SOFTWARE VERSION
    FOR  ${DEVICE}  IN  @{DEVICES}
        ${os}=    from testbed devices get "${DEVICE}.os"
        IF    "${os}" == "iosxe" and "8K" in "${DEVICE}"
            select device "${DEVICE}"
            ${VERSION_OUTPUT}=  parse "show version" on device "${DEVICE}"
            ${CFG_VERSION}=  Get From Dictionary  ${VERSION_OUTPUT['version']}  version
            ${status}=  Run Keyword And Return Status  should be true  '${CFG_VERSION}' == '${EXP_XE_8K_VERSION}'
            IF  '${status}' == 'False'
                Fail  ++UNSUCCESSFUL++ Device ${DEVICE} is not running the expected version ${EXP_XE_8K_VERSION}
            ELSE
                set test message  ++SUCCESSFUL++ ${DEVICE} is running the expected version ${CFG_VERSION}\n  append=True
            END 
        ELSE IF    "${os}" == "iosxe" and "1K" in "${DEVICE}"
            select device "${DEVICE}"
            ${VERSION_OUTPUT}=  parse "show version" on device "${DEVICE}"
            ${CFG_VERSION}=  Get From Dictionary  ${VERSION_OUTPUT['version']}  version
            ${status}=  Run Keyword And Return Status  should be true  '${CFG_VERSION}' == '${EXP_XE_1K_VERSION}'
            IF  '${status}' == 'False'
                Fail  ++UNSUCCESSFUL++ Device ${DEVICE} is not running the expected version ${EXP_XE_1K_VERSION}
            ELSE
                set test message  ++SUCCESSFUL++ ${DEVICE} is running the expected version ${CFG_VERSION}\n  append=True
            END    
        ELSE IF    "${os}" == "iosxr"
            select device "${DEVICE}"
            ${VERSION_OUTPUT}=  parse "show version" on device "${DEVICE}"
            ${CFG_VERSION}=  Get From Dictionary  ${VERSION_OUTPUT}  software_version
            ${status}=  Run Keyword And Return Status  should be true  '${CFG_VERSION}' == '${EXP_XR_VERSION}'
            IF  '${status}' == 'False'
                Fail  ++UNSUCCESSFUL++ Device ${DEVICE} is not running the expected version ${EXP_XR_VERSION}
            ELSE
                set test message  ++SUCCESSFUL++ ${DEVICE} is running the expected version ${CFG_VERSION}\n  append=True
            END      
        ELSE IF    "${os}" == "nxos"
            select device "${DEVICE}"
            ${VERSION_OUTPUT}=  parse "show version" on device "${DEVICE}"
            ${CFG_VERSION}=  Get From Dictionary  ${VERSION_OUTPUT['platform']['software']}  system_version
            ${status}=  Run Keyword And Return Status  should be true  '${CFG_VERSION}' == '${EXP_NXOS_VERSION}'
            IF  '${status}' == 'False'
                Fail  ++UNSUCCESSFUL++ Device ${DEVICE} is not running the expected version ${EXP_NXOS_VERSION}
            ELSE
                set test message  ++SUCCESSFUL++ ${DEVICE} is running the expected version ${CFG_VERSION}\n  append=True
            END
        END
    END

    
DEVICES:
    - C8Kv-01
    - CSR1Kv-01
    - XR9Kv-01
    - N9Kv-01

EXP_XE_8K_VERSION:  17.12.2
EXP_XE_1K_VERSION:  17.3.8a
EXP_XR_VERSION:  7.4.1
EXP_NXOS_VERSION:  9.3(13)

Click on the SAVE AND RUN button in the upper right-hand corner of the page

After clicking the SAVE AND RUN button, CXTM will return you to the Job File page.

Step 13 - Review the Execution status

From the test case Job File page:

Review the Execution status
Confirm that the Execution status is COMPLETED

Step 14 - Review the Run History

From the test case Job File page:

Refresh your browser
Confirm that the result is PASSED

Alert

Notify your proctor if your test case result is not PASSED before moving on.

Step 15 - Access the Job File result

From the test case Job File page:

Click on the timestamped link under the Run History

Step 16 - Review the Job File result

From the Job File Results page:

Click on the on log.html link under Artifacts

Click on FOR ${DEVICE} IN [ @{DEVICES} ] to expand
Click on ITERATION ${DEVICE} = C8Kv-01 to expand the first iteration of the FOR loop

Close the log.html report and return to the Job File Results page.

Step 17 - Navigate Back to Project Home

From your test case Job File Results page:

Click on the Project LTROPS-2711 button

Step 18 - Review Project Dashboard

Now that a test case has been run from your project, take a moment to observe how your project dashboard has changed.

From your CXTM project's Home page:

Review the Test Cases by State table and chart

Review the Test Cases by Phase and State and Test Cases by Suite and State chart

Review the the Test Case Automation chart

Continue to the next section to create additional test cases to verify the interface state on your devices.

Devices

USER: admin

PASS: cisco.123

CSR1Kv-01 : 10.15.103.11

C8Kv-01 : 10.15.103.12

XR9Kv-01 : 10.15.103.13

N9Kv-01 : 10.15.103.14

CXTM

USER: pod03

PASS: cisco.123

GitLab

USER: pod03

PASS: cisco.123

VS Code Server

USER: user03

PASS: cisco.123

Edit Job File

Step 1 - Return to the Job File editor

Step 2 - Edit the Connect to Devices step to iterate over devices

Step 3 - Change the DEVICES variable to a list of devices

Step 4 - Edit the Verify Software Versions step to iterate over devices

Step 5 - Edit the Verify Software Versions step to get testbed attributes

Step 6 - Add conditional logic for IOS-XE C8Kv devices

Step 7 - Add conditional logic for IOS-XE CSR1Kv devices

Step 8 - Add conditional logic for IOS-XR devices

Step 9 - Add conditional logic for NXOS devices

Step 10 - Define the variables introduced in the last steps

Step 11 - Set the Default Topology to LTROPS-2711 Topology

Step 12 - Save and Run

Step 13 - Review the Execution status

Step 14 - Review the Run History

Alert

Step 15 - Access the Job File result

Step 16 - Review the Job File result

Step 17 - Navigate Back to Project Home

Step 18 - Review Project Dashboard