EXFO Service Assurance

Günter Moosbauer
Technical Sales Engineer – Service Assurance

Filippo Belloni
Regional Sales Manager

August 2019
Agenda

Introduction EXFO – Company und Portfolio

EXFO Active Assurance

EXFO Worx Platform
Use Cases
Our Market and Technologies
Our Market and Technologies
Our customers

© 2018 EXFO Inc. All rights reserved. 5

Manage network & service performance
within a virtual and physical environment
Third party systems
BIG DATA ANALYTICS NFV Orchestration
& applications OSS/BSS
Performance Service Advanced
Geoanalytics
management & Subscriber Use cases
D
Machine Learning & AI
EXFO
PROFESSIONAL SERVICES

TEST MONITORING & TROUBLESHOOTING partners

Simulators Fiber Video Fronthaul Intelligent

automation

Field test
IP transport Business services RT alerting
automation
Published
APIs / NBI Portable End-to-end Dynamic topology Mobile
test tools troubleshooting modeling RAN & core

Real-time processing Correlation Aggregation

DATA ACQUISITION

OSS Hardware Virtual Network Network/service

OSS/EMS CRM
call traces probes probes telemetry inventories
© 2018 EXFO Inc. All rights reserved. 6
Prof.Services & Value-added services

QUALITY ASSURANCE NETWORK OPTIMIZATION

NETWORK EVOLUTION SUBSCRIBER INSIGHTS

CONFIGURATION
SERVICE PORTFOLIO & CUSTOMIZATION
TRAINING CONSULTING

© 2018 EXFO Inc. All rights reserved. 7

segments

Broadband
Market

Mobile access Mobile core Enterprise

RAN/fronthaul/backhaul EPC/IMS Business services Residential services

Drive network
Ensure last mile Automate service Assure last mile
& digital
best experience lifecycle convergence
transformation
Mission

Domains: Domains: Domains: Domains:

• RAN optimization, backhaul and • Service & network monitoring, • Service activation, network & • Consumer service
Business domains

fiber monitoring SOC, customer care, CEM service monitoring & access network monitoring,
SOC, customer care, CEM
& challenges

Challenges: Challenges: Challenges: Challenges:

• RAN Transformation • Network automation • Automating service delivery & • Convergence of fixed & mobile
with C-RAN & FTTA • NOC to SOC transformation activation access technology for consumer
• Monitor & optimize last mile user • QoE of broadband services • Accelerating issue resolution services
experience • Introduce new architecture with automated root cause • Ubiquitous consumer services
& locate issues. & services: NFV/SDN, IoT, 5G analysis monitoring
• Prepare new services • SLA management & reporting • Accelerating issue resolution
introduction IoT/5G

© 2018 EXFO Inc. All rights reserved. 8

EXFO Active Assurance
Active Assurance

© Günter Moosbauer
EXFO Service Assurance at a glance

Strong global presence with over

150 deployed systems worldwide
Over 100 customers worldwide
Telco ISP/Tier 2 MSOs Wireless
Main use cases
– Centralized and automated service activation

– Mobile backhaul assurance

– Core mesh performance assurance

– Active service quality assurance (QoE)

– Proactive service operation use cases with root-

cause and service impact analysis and
performance segmentation (with Ontology)

© 2017 EXFO Inc. All rights reserved. 11

Active Assurance – A Must
15 minutes

© bilder.4ever.eu
Monitoring: Why is it Important?
Example: Effects of bad Network Performance

Examples of problems caused by:

› Packet Loss
› Jitter
› Out-of-order packets
Network performance will directly impact Subscriber Experience
Network KPIs impact on subscriber’s experience

Frame Delay
Delay
Loss Variation

VoiP Video Data

Unclear Pops/ Delays/ Image Playback Failed Long
Dropouts
speech clicks gaps quality Buffering transfer transfers

Frame loss X X X X
X
X X

Delay X X X X

Delay X X
X X
Variation
Active Assurance: 2 key approaches

On-Demand test & Continuous performance

Active testing assurance
troubleshooting
- Immediate execution of test routines with - 24/7 sampling of network and service
limited execution durations performance using traffic injection
- Typically API driven for high automation - Leverage test probes for traffic injection
- Leverage test probes for traffic injection Test near Users - Different test architectures:
- Different test architectures: - Single-ended (probe to service)
- Single-ended (probe to service) - Probe to probe
- Probe to probe - Probe to multiprobes (Mesh)
Test in Network

- Typical Use-cases: - Typical Use-cases:

- Line rate service activation - Mobile backhaul performance
- Triple-play service troubleshooting - Active Synthetic Traffic Injection - MPLS core Isolation
- Service isolation - Pro-active QoS and QoE assurance - Business service assurance
- Deterministic and preventive - Infrastructure assurance
- SLAs Segmentation, Isolation
- Largest deployment in the World
EXFO Active Assurance Domains of Interest

NFV/SDN VoIP
E2E MOBILE NETWORK VoLTE / VoWiFi
ASSURANCE

ETHERNET/IP Ethernet / IP IPTV and OTT Video

SLA ASSURANCE Activation DELIVERY

All-In-ONE
Solution for
ALL IP
based
Networks

© 2019 EXFO Inc. All rights reserved. | 5

EXFO|Worx Performance Management System
Consolidation, Correlation, Analysis and Reporting in Real-Time or Historical

› Service Activation & Testing

› Network Performance
Monitoring
› Capacity Planning
› Change Management
OSS/BSS
› SLA Management › Data extraction
› Provisioning
› Fault management
Real-time reporting and dashboards › Trouble ticketing
› Billing
› Single sign-on
Real-time automated
network analysis Business intelligence
and trending
Data › Real-time dashboard and
business intelligence
› Correlation and aggregation engine
› Collection and aggregation Open
› Test suite software API
Source for Measurements

EXFO Verifiers OAM Support SNMP › Service Quality Management

› Dedicated Test HW › L2/L3 Loopbacks › Cisco IPSLA EXFO|Worx Connector › Performance & Fault
› QoE Agents › Y.1731 Responders › Juniper RPM Management
› TWAMP › Configuration › Capacity Management
Responders › Utilization › Dashboard, topology, and
› SIP Media Loopback › PM heatmap
› Echo Servers
EXFO Verifiers: Performance Visibility in any format

Virtual Agent (EVA) Virtual Verifier (VNF) Physical Verifiers (BV)

Software agent for non-hypervisor host ETSI-compliant VNF for deployment on Hardware Accelerated Physical test probes
devices. hypervisor-enabled environments Physical format

Available format: VNF Format: - Guaranteed performance

- Dockers and binary files – OpenStack Nova - Hardware timestamping with us level accuracy
- Application compiled for Linux/Debian – Oracle VirtualBox - Variety of form factors and interfaces (100M to 10G)
- Can be adapted for different host devices – VMWare ESXi
– KVM/Xen

Virtualized Core
Cloud Tenants Single Board Thin CPEs vCPEs
Platforms
computers

Hypervisors

Advanced
Gateways and
Select OpenWRT Physical Verifiers
Devices (BV-3100/BV-110/EX1-v)

© 2019 EXFO Inc. All rights reserved. 18

Introducing EVA
What is EVA? Why EVA?
EVA (EXFO Verifier Agent) is a Software • Address new open devices which do not
Agent for Active Performance testing. have hypervisors (small whiteboxes)
It is a Software Verifier in an Application
Format. • Go in the cloud!

Virtual Verifier (VV) Virtual Agent (EVA)

It is …. A Virtual Machine An Application

Installs on… A Hypervisor A guest OS (like Call of duty on Windows)

(Openstack for example)
Host Platform… Has to be virtualized Can be virtualized (like a VM on Virtualbox) or

Resource consumption More intensive Much less intensive:

(Min: 512MB RAM, 1vCPU, Fixed 2G Storage) (Min: 20MB RAM, shared CPU compute, 25MB on
disk, may increase to 50 with more plugins)
How restrictive More control on IP Stack with support for IP Less control as it relies on the Operating System
alias, multiple interfaces etc… © 2017 EXFO Inc. All rights reserved. 19
EVA, VV, Physical Feature Compare
EVA VV BV
Turnup Yes (Software) Yes (Software) Yes (FPGA Assisted)
iPERF Yes Yes Yes
Ethernet/IP SLA Assurance Yes Yes Yes
SIP VoIP Yes Yes Yes
Video Yes (10.1 release) Yes Yes
Data and Web Services Yes Yes Yes
Interface support Single and Multi-Interface(10.1) Single and Multi-Interface Multi-Interface with Dedicated
Management Interfaces
Throughput Performance Dependent on OS/Hardware Dependent on Hardware, can be Line rate support with built-in FPGA
accelerated using SR-IOV/DPDK assist

Timestamp accuracy Millisecond range 100s microsecond range 1us range with hardware
Can be stabilized with OS NTP/PTP Can leverage NTP and custom timestamping
support drivers
Source IP Parameters control Source IP provided by host platform Yes Yes

Interface Category Yes Yes Yes

API Operation Yes Yes Yes

Availability Available today! Available today Available Today

© 2017 EXFO Inc. All rights reserved. 20
EVA Test Capabilities (Launch)

EVA Launch tests

Active Ping Test (Periodic, Continuous)
RFC5357 Two Way Active Measurement Protocol (TWAMP)
RFC5357 TWAMP Responder
iPERF v2 Client/Server
iPERF v3 Client/Server
One-way performance Test
FTP Availability
FTP MultiConnection
FTP MultiFile Perf.
FTP Performance Active
HTTP Active
HTTP Availability
HTTP MultiConnection
HTTPS Active
DNS Active
Adv. VoIP SIP Service Active test (Place real calls)
Adv. VoIP RTP (Measure synthetic VoIP traffic)
Traceroute Active Test
Y.1564 Service Activation Test (EtherSAM)
SOAM-PM Periodic
SOAM-PM Continuous

© 2017 EXFO Inc. All rights reserved. 21

Deploying Verifiers for complete Visibility
Virtual Agent (EVA)
Visibility in Core: Visibility at intermediate points:
- VV on HyperVisor on host device - EVA on device with compute Node
- Physical Verifier attached to port - EVA on raspberry pi Virtual Verifier (VNF)
- VV on HyperVisor on host device
- Physical Verifier attached to port
Physical Verifiers (BV)

Visibility at the Edge:

- EVA on thinCPE
- EVA on Raspberri Pi
- EVA on EX1
- VV on vCPE

© 2017 EXFO Inc. All rights reserved. 22

Examples of Solution Deployment Use Cases (>150 active tests supported L2 to L7 )
QoS & QoE Multi-Service Active Assurance for Fixed and Wireless networks

ALL VERIFIERS DO L2 to L7
ACTIVE TESTS: BV-3100
HTTP/Web, VOIP/VoLTE/VIDEO,
FTP, Email, PING, DNS,
Diameter/IMS, UDP Echo, DHCP, BV-1/BV-110
IPTV, TWAMP, Y.1731, 802.1ag etc.
PE-B
Mobile Backhaul
Ethernet/IP/Transport monitoring
CPE ONT
assurance (TWAMP,
Y.1731, 802.ag): CORE / Aggregation
Latency and Jitter CPE
ONT IP Backhaul TURN-UP
(RTD, One-way delay - OLT/ PE-C
PE-A Service
DSLAM
UVS), Packet Loss, out
of order, duplicate
CPE
Activation

CPE

BV-110/BV-1100 BV-110

FTTB/FTTH Assurance
IP MPLS, Core, Aggregation,
Mobile Backhaul, IP Backhaul
Turnup monitoring
Assurance

EXFO|WORX ONE SYSTEM

ONE SOLUTION
Intra/Inter Data
Center Assurance
 EXFO|WORX
Datacentre and Enterprise Customer

DC to service
Step 1: Certify Service Onboarding before delivery to subscriber/users:

• On-Demand testing
• Can be fully automated via APIs for sequencing and Pass/Fail
actions
• Integrate all results into OSS for DevOps and OSS Triggered actions

Step 2: On-demand/Continuous 24/7 Assurance of

Service Delivery

• Periodic Assurance
• Can be fully automated via APIs for sequencing
and Pass/Fail actions
• Integrate all results into OSS for DevOps and
dynamic adjustments of network slices based E2E Segment
on measured metrics
• Mesh performance testing

Sample Actions:
Step 3: Segment performance between probes
• Unidirectional and Bi-Directional Ethernet/IP Performance assurance
• Isolate network slices between probes • VoIP/Video Assurance Signalling and Media Performance
• Can be fully automated with API driven test sequences • Cloud Services Performance (availability and Transport Performance)
• Either continuous assurance or in troubleshooting mode only • Service Rate Validation between Probes or to endpoints
© 2017 EXFO Inc. All rights reserved. 24
EXFO Worx Active test catalog
EXFONGN Ethernet Tests TCP Echo Active test Advanced VoIP—SIP Traceroute Active Test Advanced VoIP—NCS Signaling Passive Test
Ethernet Y1731 SOAM-PM Continuous/Periodic Active Test Treno Active Test Advanced VoIP—VoLTE Service Active Test Advanced VoIP—ISUP Signaling Passive Test
Ethernet Loopback Test EXFONGN Web Tests
Ethernet CCM Passive Test HTTP Active Test EXFOCall H323 Active Tests
Ethernet Link trace Test HTTPS Active Test Advanced VoIP—H323 Gatekeeper Availability Active Test EXFODiameter Active Tests
Ethernet Throughput Availability Test HTTP Multi-connection Active Test Advanced VoIP—H323 Service Active Test Diameter Cx/Dx Active Test
Ethernet MEP discovery (NEW in 89) Web Application Script Active Test
RAD NID Y1731 Test HTTP Availability Test EXFOCall H248 Active Tests EXFOVision Network Multicast Video Active Tests
RAD NID Port Test HTTP Active (Cisco IP SLA) Test Advanced VoIP—H248 Gateway Controller Availability Active Test IPTV Multicast Active Test
RAD NID Flow Test TLS Connectivity test (NEW in 89) Advanced VoIP—H248 Golden Phone Service Active Test Multicast Channel Receiver Active Test
Multicast Channel Server Active Test
EXFONGN IP Network Tests EXFONGN E-Mail Tests EXFOCall MGCP and NCS Active Tests
One-Way Performance Active Test IMAP Availability Active Test Advanced VoIP—MGCP Gateway Controller Availability Active Test EXFOVision Video Active Tests
Abbreviated One-Way Performance Active Test POP3 Availability Active Test Advanced VoIP—MGCP Golden Phone Service Active Test Advanced Video—OTT Service Active Test
Two-Way Active Measurement Protocol Sender Test SMTP Availability Active Test Advanced VoIP—NCS Gateway Controller Availability Active Test Advanced Video - RTP Network Active Test
Two-Way Active Measurement Protocol Reflector Test SMTP/IMAP E-Mail Performance Active Test Advanced VoIP—NCS Golden Phone Service Active Test Advanced Video—RTSP Active Test
Continuous Two Way Active Measurement Protocol SMTP/IMAP E-Mail Performance Active (Mail Hops) Test Advanced Video—H323 Service Active Test
Ping Active Test SMTP/POP3 E-Mail Performance Active Test EXFOCall SCCP Active Tests Advanced Video — SIP Video Active Test
Continuous Ping SMTP/POP3 E-Mail Performance Active (Mail Hops) Test Advanced VoIP—Cisco CallManager Availability Active Test
Ping Active (Remote Router) Test Advanced VoIP—SCCP Network Active Test EXFOVerifier Tests
ICMP Echo Active (Cisco IP SLA) Test EXFONGN File Transfer Tests Advanced VoIP—SCCP Service Active Test BV-10 Reflector Test
ICMP Timestamp Active Test FTP Performance Active Test Ethernet OAM Reflector Test
LSP Ping Active (Cisco IP SLA) Test FTP Multifile Performance Active Test EXFOCall Media Active Tests TWAMP Reflector test
Traceroute Active Test FTP Multiconnection Active Test Advanced VoIP—RTP Network Active Test SmartLoopback
Path Echo Active (Cisco IP SLA) Test FTP Availability Active Test TLS Connectivity test (NEW in 89) TCP Echo Server Test
FTP Performance Active (Cisco IP SLA) Test RTP Service Active test (NEW in 89) UDP Echo Server Test
EXFONGN Infrastructure Assurance Tests TFTP Active Test Advanced VoIP—PESQ Network Active Test NTP Status Test
DNS Active Test Secure FTP Performance Active Test Advanced VoIP — POLQA Active Test
DNS Active (Cisco IP SLA) Test Secure FTP Availability Active Test Advanced VoIP—Prequalification Responder Test
DHCP Active Test Secure Copy Performance Active Test VoIP-RTP Active Test
DHCP Active Test (Cisco IP SLA) Secure Copy Availability Active Test VoIP-TCP Active Test
NTP Active Test Network Management Tests Jitter Active (Cisco IP SLA) Test
LDAP Service Active Test SNMP Active Test VoIP-UDP Jitter Active (Cisco IP SLA) Test
RADIUS Active Test Router Status Active Test
PPPoE Session Active Test EXFOCall Passive Monitoring Tests
PPPoE Active Test EXFONGN Turn-Up Tests Advanced VoIP—Media Passive Test
Iperf Performance test (Iperf2/3) RFC2544 Turn Up Test Advanced VoIP—SIP Signaling Passive Test
EtherSAM (ITU-T Y1564) Turn Up Test Advanced VoIP—SIGTRAN Passive Test
EXFONGN UDP Application Tests TCP Throughput Client Turn-up test Advanced VoIP—BICC Signaling Passive Test
UDP Bandwidth Active Test TCP Throughput Server turn-up test Advanced VoIP - RANAP luCS Passive Test
UDP Echo Active Test Advanced VoIP—Diameter Monitoring Passive Test
UDP Echo Active (Cisco IP SLA) Test EXFOCall SIP Active Tests Advanced VoIP—ENUM Monitoring Passive Test
Advanced VoIP—SIP Network Active Test Advanced VoIP—GTP Passive Test
EXFONGN TCP Application Tests Advanced VoIP—SIP Proxy Server Availability Active Test Advanced VoIP—H248 Signaling Passive Test
TCP Connectivity Active Test Advanced VoIP—SIP Assured Services (AS-SIP) Active Test Advanced VoIP—H323 Signaling Passive Test
TCP Performance Active Test Advanced VoIP—SIP Service Active Test Advanced VoIP—MGCP Signaling Passive Test © 2018 EXFO Inc. All rights reserved. 25
EXFO Verifiers: The most complete active probe in the market

Up to line rate service activation

Key highlights to vendor’s loopback or L2/L3 loopback
Y.1731/TWAMP endpoints using
Y.1564 or RFC-2544 Service activation using
– Powerful high BW Service methodologies Y.1731 endpoint Y.1564/RFC-2544/6349
Activation capabilities with
support for standards-based
TWAMP responder
methodologies:
High bandwidth service activation tests
– Y.1564 / RFC-2544 (Ethernet/IP) RFC-6349 TCP performance RFC-6349 TCP test
– RFC6349 (TCP)

– iPERF
L2-L7 performance and service monitoring
– Extend to higher layer, over
150 L2-L7 tests available via Monitoring over Ethernet links 24/7 performance metrics
using OAM protocols
Y.1731 endpoint
via ITU-T Y.1731
software enable including:
– VoIP with Signalling and Media Monitoring over IP links using 24/7 performance metrics
TWAMP (RFC-5357)
TWAMP reflector
Quality support via RFC-5357 TWAMP
– Video EXFO Active Probe
Availability and basic monitoring IP Address / IP, ICMP and RTP
– Data Services (IP, Web, UDP/TCP) H/W and Virtual
using Ping/Echo to IP host ICMP responder performance
– Infrastructure quality
Extensive VoIP, video and web VoIP/video/web
– Tests can be run on-demand performance such as SIP, IPTV VoIP/video/web
and HTTP tests performance
or in periodic mode
Measure connectivity and DNS/DHCP/
– Completely interoperability Infrastructure assurance
response time of critical servers diameter
between probes formats
Test Automation : EXFO|Worx Open APIs

Integration with third party systems:

- Retrieving test results
- Searching external inventory systems
or database to populate tests Inventory

APIs
Process and Interface: EXFO Physical/virtual probe
- Adapted UI
- Integration with OSS/BSS
- Automation of process and MOPs
OSS
EXFOWorx

SDN/NFV Integration:
- SLA/PM results retrieval for SDN controllers
- Automatic configuration of verifiers in NFV Available APIs:
- Automatic launch of tests in NFV SDN controllers - CSV/XML/PDF result export
NFV Architectures - REST API
- SOAP method
- PERL Scripting
EXFO’s solution: Proven Interoperability with
major vendors, reduces deployment cost*

Model L2 OAM/ L3 TWAMP

Model L2 OAM/TWAMP Flexi MultiRadio BTS Yes (Y.1731)/Yes (Light)
Model TWAMP
PTN Optix Yes
RBS 640X Yes 7950/7705/7750 Yes (Y.1731)/Yes (Light)
ATN910B TWAMP Full

Model L2 OAM L3 TWAMP Model L2 OAM L3 TWAMP Model L2 OAM Model L2 OAM
8609/8602 Yes Yes (Light) 2941/2901 Yes Yes (full) Flashwave CDS Yes 7750/ 7705 /7450 Yes
8615/8630 Yes Yes (Light) 4910 Yes Not Supported
8660/8665 Yes Yes (Light) ME-3750 Yes Yes (Full)
ASR Yes Yes (Full)
901/903/1001 Model L2 OAM L3 TWAMP
MRV OST Yes Yes (Light)
Telco T-MARC Yes Yes (Light)
Raisecom OST Yes
Model L2 OAM
Accedian NID Yes Yes (Light)
3916 / 310 / 311 Yes
OE Solution/AimValley Yes Yes (Light)
RAD ETX, MiNID Yes Yes (Light)
* List not comprehensive
Conclusion
Key Takeaways

Over 150 active performance monitoring

deployments globally Open architecture and vendor agnostic
Proven scalability to 100 000+ endpoints
(Vodacom South Africa, BT and Vodafone platform
with a single system
UK, Germany and Spain, Verizon and AT&T Leverage vendor responders to reduce
Do not sacrifice visibility and coverage:
USA, Telus and Bell Canada, Turkcell deployment costs. Integration via API with
solution evolves with your needs.
Turkey, Etisalat and DU UAE, Singtel and OSS/BSS systems.
Malaysia Telecom etc.)

L2 to L7 in one product Proactive network Performance Reporting &

Proven Leadership in Service Activation and
Performance Assurance. License based, no need to add or change Visualization
hardware! Enrich Operators with EXFO’s Analytics
Founding member of established
standards (TWAMP, Y.1564). 150+ active tests – most complete active Platform (Xtract) and Ontology with E2E
probes in the Market Topology, Service and Customer view.
© Erdinger Weißbräu
© Günter Moosbauer
© 2017 EXFO Inc. All rights reserved. 31
THANK YOU