FPP_Telecoms_combined+presentations_030613

8/20/2019 FPP_Telecoms_combined+presentations_030613

http://slidepdf.com/reader/full/fpptelecomscombinedpresentations030613 1/87

Flexible Plug and Play

Dave OpenshawSenior Adviser – Future Networks




Moving towards a low carbon economy:

How will telecommunications will facilitate and play a role within smart grids

Mark Fiske- Operational Telecommunications Manager



2011. UK Power Networks. All rights reserved

UK Distribution Network Operators




Telecontrol History for LPN Region – Anker Box

• First installed in 1950s

• Local display withaudible alarm

• 6 Grouped Alarms Inc.1. Transformer2. Fire3. Switchgear

4. Charger




Telecontrol Marshalling cubicles

– Anker Box

• First Local Display withrepeat outputs installed in1965

• Tone and Hard wired

Comms Systems used totake the outputs to aManned control room





– Anker Box

• First installed in 1977

• Local display andinterface cubiclesinstalled in Manned

Control room

• RTU added 2 yearslater and cabled to theinterface cubicles

• Control Rooms de-manned in 1980s

1977 1979


http://slidepdf.com/reader/full/fpptelecomscombinedpresentations030613 7/87 2011. UK Power Networks. All rights reserved

London Area Control Centre 1960’s –

Streatham

– Anker Box• Centralised control

room equipped withVDUs

• VDUs connected to2 separate systems,x1 BengeworthRoad and x1Finsbury Market



4080 Telecontrol Computer

– Anker Box

• 4080 Computer Suite at

Bengeworth Road

• 2 Computers with acommon interface out tothe RTU’s (x35)

• Each Computer had256k RAM

• A magnetic drum of 256tracks totalling 2 Mbyte

• Fixed magnetic disk of 4Mbyte for picture storage

• Removal 4 Mbyte disk fordata handling




– Anker Box

• First installed in 1997

• Local Display andinterface cubiclesincluding an RTU

• Communicating backto the Corgis controlsystem using LPNTelephone cablesand in-house

Modems




Telecontrol Equipment cubicles

– Anker Box

• Latest display from 2012

• Using LCD screen driven by the RTUprocessor

• Display may comprise of many pages of

information

• Typical 15 Panel 11kV or 33kV switchboard-x48 Controls, x320 status indications &alarms, x64 analogue measurements.

• Scalable up to 1800 digitals, 200 analogues,300 controls for our largest sits.

• Serial Data communication with protectionrelays also used obtained more data




Current Operational Overview for the

LPN Region

– Anker Box

• 174 Grid and Primary RTUs

• 9471 Secondary RTUs

• 36 Cable Pressure RTUs

• Primary Comms – CableNetwork

• Secondary Comms – GPRS




Operational Overview for the EPN Region(Eastern)

• 677 Grid and Primary RTUs


• Primary Comms - Satellite withGPRS Backup

• Secondary Comms - VodafonePaknet




Operational Overview for the SPN Region(South East)

– Anker Box

• 489 Grid and PrimaryRTUs


• Primary Comms Satellitewith GPRS backup

• Secondary Comms – Vodafone Paknet




EPN & SPN Primary Telecontrol Network

Diagram

GPRS

Satellite

RT

GPRS

Modem

Substation x 600

Serial Com

APN

Router

Switch

/ Hub

ACS Server

Enmac FEP A

Enmac FEP B

HA Pair

Firewall

Switch/ Hub

Enmac Server

Enmac

Workstation

Enmac

Workstation

Enmac Server

EDF Wan

Switch

/ Hub

RTU

CONTROL CENTRE

IP Address 10.48.?.?

Subnet 255.255 .255.192

10.52.23.?

255.255.255.0

10.48.2.?

255.255.255.192




Satellite Earth Station

15




SMART Networks SCADA solutions

16

SCADA Matrix•xDSL Communication •3G

•Digital Radio •LTE

•

Paknet • Airwave•GPRS •WiMax

•UKPN Fibre & Copper circuits •Zigbee

Type Remote Control & Indication Protection/FPI Average Analogues Local HMI

A More than 800 digitals N/A Yes Yes

B 500 - 800 Digitals N/A Yes Yes

C 150 - 500 Digitals N/A Yes Yes

D Up to 150 Digitals FPI Yes Optional

E Up to 4 Switches or CB's FPI Yes LCU/HMI Required

F Pole Mounted CB Protection/FPI Yes LCU/HMI Required

G Asset Management Data N/A No No










Smart Solutions for Connecting Distributed GenerationSotiris Georgiopoulos




• Introduction to Flexible Plug and Play

• Trial location

• Case studies

• Overall project plan

• Concepts to keep in mind throughout the day

20

Contents




Objective: Cheaper and faster connection of DG to constrained parts of the network by

trialing smart grid technologies and smart commercial agreements

Duration: 3 years: January 2012 - December 2014

Project Value: £9.7 million (6.7m funding from LCNF Tier 2)

Partners:





Connected Wind Farms

Consented Wind Farms

Received Applications Wind Farms

Scoping Sites Wind Farms

Grid Substation

Primary Substation

33 kV 132 kV 400 kV

Location: Cambridgeshire

Surface: ~ 700km²

Network: 33kV and 11kV Network (2 Grid, 10 Primary substation sites)

Connected Renewable Generation: 120MW

Planning & Delivery Stage: approx 270MW

Flexible Plug and Play:

Trial location



2011. UK Power Networks. All rights reservedClassification: Restricted23

The challenge – March Grid (case study)In the context of the heat map

Constraints

(focus on 33 and 11kV)

• Reverse power flow

limitations

• Thermal line limits



2011. UK Power Networks. All rights reservedClassification: Restricted24

The challenge – March Grid (case study)

Constraints

• Reverse power flow limitation (N-1)

due to protection – set at a max of

75% rating of the transformer

• Constraint occurs at min Load max

Gen situations

Consequences

• Substation considered full

• Very expensive quotes forconnections to projects in the vicinity

(Distance or increased voltage level)

GLGenerator Load Circuitbreaker

Case Study 1: March Grid

The challenge




• Reverse power flow limitation (N-1)

due to legacy protection – currently set

at 75% rating of the transformer

• Solutions:

Novel protection scheme

Active Network Management

IP Communications

Suitable commercial &

contractual framework

25

G

Interruptible generation

Interruptible generation

MEASURE

CONTROL

CONTROL

G

Case Study 1: March Grid

The solutions




Local Substationthermal constraint

Proposed NewGeneration Project

ANM

WAN /

RF Mesh

Proposed New

Generation Project

New 33kV

underground cable

Closest point ofconnection

Case Study 2: Single Wind FarmDynamic Line Rating

DLR

Business as Usual:• Higher costs

• Longer lead times

Local Substationthermal constraint

Smart Solution: Smart Device – Dynamic Line Rating (DLR)

Active Network Management (ANM) System

Smart Commercial Arrangements



2011. UK Power Networks. All rights reserved 27

Sep

2012

Dec

2012

Mar

2013

Jun

2013Dec 2014

SDRC 9.1

Stakeholder

Engagementreport

SDRC 9.3IP Comms

Platform - LIVESDRC 9.8

Deploy Quad

Booster

Sep

2013

SDRC 9.4

Demonstrate FPP

Characteristics (ANM live)

Completion of core

infrastructure deployment

SDRC 9.6

Offer of FPP

connection to real

customers

SDRC 9.7

Demonstration of

active power flow

and voltage

management

SDRC 9.5

Delivery of Strategic

Investment

Model

Trial Participant Engagement

SDRC 9.2

Development of

smart commercial

arrangements

FPP Connection

offers First issue

to customers

TimetableSuccessful Delivery Reward Criteria - SDRC




Systems integrationSmart applications

Knowledge DisseminationCommercial arrangements

Strategic Investment ModelSmart devices

Telecommunications

Platform

Stakeholder Engagement1 5

2 6

3 7

4 8

Project Overview




Concepts to keep in mind

• Distributed Generation

• Smart Devices

• Smart Applications – Active Network Management

• Interruptible connections










Technical design and architecture

Tim Manandhar




• Flexible Plug and Play solutions

• Key design principles

• Technical architecture

• IEC 61850 design• Data Optimisation

• Technical Challenges

Contents




Flexible Plug and Play Solutions

34

Smart application and smart devices

Dynamic Line RatingActive Network Management

Quadrature Booster Transformer

IEC 61850

communications

Quadrature Booster Control system

Upgraded RTU

Automatic Voltage Controller

http://www.silverspringnet.com/




Key Design Principles

35

Autonomous, scalable and resilient

No interference to SCADA systems

Dual redundancy architecture

Fail safe modes

Information security




ANM’s real time traffic requirements – High speed and low data errors

High Availability – Active and on demand control of Generator export

ANM Data throughput – Simultaneous multiple device communication

IP based platform – support of IP based protocols

Non-functional requirements – Physical and environmental

Design Methodology

Communications Platform: Radio mesh and Wide Area network

Functional Use Cases

Functional Requirement specification




Design Methodology

Functional Use Cases

Functional Requirement specification

Design and Deployment

Design Process

TRIAL Design

Testing and Commissioning




Flexible Plug and Play: Architecture

C o n t r o l C e n t

r e

S

u b s t a t i o n

G

e n e r a t o r

Status and measurements

Smart devices

SCADA system

ANM

S C A D A

C o m m s

Power export = 10 MW

Curtailment = 10 %

Power export = 9 MW




Communication protocols

ANM to ENMAC: DNP3 (Distributed Network Protocol)

Time synchronisation: Simple Network Time Protocol (SNTP):

Features of IEC 61850 standard

Development over the last 15 years – IEC Technical committee 57

Defines entire Engineering process – Full life cycle of system

Focuses on functions rather than equipment or boxes

Backward compatibility from edition 2 to edition 1

Trial of IEC 61850: Using MMS (Manufacturing Messaging

Specification) protocol




IEC 61850 features

FPP specification: The FPP Technical Solution shall utilise the following elements of

the SCSM of IEC 61850 standard communications as defined in IEC 61850‐8‐1:

a) Core ACSI services, which shall be supported via MMS Protocol Suite support;

b) Time synchronisation services, which shall be supported via SNTP support.

Trial objectives for IEC 61850

Flexibility and Interoperability by vendor agnostic feature

Efficiency in system integration

Demonstrate future cost reduction

Support “Fit and Flex” approach for smart grid vision

Future development areas of IEC 61850Extend from communication interoperability to Engineering

interoperability

Support grid integration of renewable power and distributed

energy resources




Smart Grid Architecture

SGAM (Smart Grid

Architecture model)

EU standardisation initiative

for smart Grid with CEN,

CENELEC and ETSI

FPP Interoperability goal in the communication layer using IEC 61850




0

50

100

150

200

Generators 612

1824

Data optimisation

FPP Trial Area

As more Generators connect

Data loading increase

Data loading

(kbps)

Challenges

Bandwidth constraints in Radio mesh

Requirement of high speed and high availability of ANM communications

Hence, Data optimisation is required




Technical challenges

• Reliable technical solution for Generation customers

• System integration and Interoperability

• Efficient and optimised use of IEC 61850 data

• FPP trial – smart devices and real Generation customers

• Design of interface between ANM and Generator control system

• Business embedment for future implementation of FPP solutions






Dave Openshaw

Senior Adviser – Future Networks



Communications Platform – (SDRC 9.3)Lynne McDonald and Simon Dunkley


C i ti F ti




C o n t r o l C e n t r e

S u b s t a t i o n

G

e n e r a t o r

Communications Function

Data connectivity both

within and between

substations.

Address interoperability as

a range of smart devices

from multiple vendors.

Data exchange and control

capability to implementtechnical and commercial

solutions.

Accelerated and cost-

effective connection of

distributed generation.

Comms




Objective: Cheaper and faster connection of distributed generation to thenetwork by trialing alternative smart connection solutions.

Robustness

Scalability

Ease and speed of installation

Repeatability

Interoperability

48

Communications Requirements




IP – based platform that combines the Wide Area Network (WAN) using the

Multi Service Platform (MSP) network with a Radio Frequency (RF) MeshNetwork.

Wide Area Network (WAN) Radio Frequency(RF) Mesh Network

Robustness InteroperabilityScalability

49

Selected Communications Platform




Successful Delivery Reward Criteria: SDRC 9.3

SDRC 9.3: Deployment of an IP communications platform across the Flexible Plugand Play trial area – Q1 2013

Evidence:

• Sign-off of successful installation and commissioning of the IPcommunication infrastructure.

• Results for IEC 61850 communication trials using IEC 61850 simulators atvarious locations in the trial area.




Active Network

Management

system

grid

substation

grid

substation

primary

substation

primarysubstationprimary

substation

primary

substation

primary

substation

primary

substation

primary

substation

primary

substation

primary

substation

primary

substation

Peterborough

March

51

Trial Area




ANM

RouterRouter

Peterborough

Central

Grid

March Grid

Master

eBridge

Remote

eBridge

Key

RF Mesh link

WAN link 52

RF Mesh Networking: route diversity




RouterRouter

ANM

Peterborough

Central

Grid

March Grid

Relay

53

RF Mesh Networking: preferred routes

Key

RF Mesh link

WAN link




RouterRouter

ANM

Peterborough

Central

Grid

March Grid

54

RF Mesh Networking: failover

Key

RF Mesh link

WAN link




RouterRouter

Access

Point

ANM

Peterborough

Central

Grid

March Grid

Gridscape

55

RF Mesh Networking: network management

Key

RF Mesh link

WAN link

Communications Infrastructure Overview




1. Wide Area Network2. RF Mesh Network3. Local Area Network4. GridScape – Management tool

Four key components of the IP-based communications platform:

56

Communications Infrastructure Overview

Communications Hardware




eBridge

(Remote and Master)

Relay

Access Point

Field Service Unit

57

Communications Hardware

Communications Software




Gridscape

Communications tester

58

Communications Software

RF Mesh Network: design activities




Location

Data

Initial

Design

Site

Surveys

Enhanced

Design

Network

Build Optimisation

Final

Design

59

RF Mesh Network: design activities

Communications Solution: heat map




Communications Solution: heat map

Communications Solution: link model




Communications Solution: link model

Communications Solution: installation




Antenna

install at substation

Relay install at

tower

Relay install at

Low Voltage pole

Router Cabinet

install at grid

substation

62

Communications Solution: installation

Communications Solution: testing




IEC 61850: Ability to transport and trafficthe open standard protocol.

RF Mesh Network: The capabilities,

functionalities and performance.

Wide Area Network: IP multicast capability,IP route summarisation and RF Mesh

filtering.

63

Communications Solution: testing

Network Performance




Metric Target Result

Packet reliability > 90% 99.76%

Round Trip Time (RTT) < 1s 320ms

Throughput 30kbps70kbps (1 hop)

30kbps (3 hops)

Route Diversity (neighbours) 2 3.1

Failover time (lost relay) < 5 minutes 1 minute

64

Network Performance

IEC 61850 tests




1. GetDirectory discovery of data components on a Remote server2. Periodic GetDataValues polling of data3. Progressively more rapid GetDataValues polling of data to demonstrate multiple reads

per seconds4. Conveyance of Standard Network Time Protocol (SNTP) messages5. Trapping of exception messages

Five distinct tests were performed:

IEC 61850 tests

Standard Network Time Protocol (SNTP) test




Standard Network Time Protocol (SNTP) test

“SNTP time synchronisation event simulated: this is useful in the scenario where

a generator site does not have GPS. It enables all Flexible Plug and Play

components to be synchronised with the same clock and for accurate recordingof each event to be taken e.g. control signal for curtailment action when sent and

received”

Failover Modes




Failover Modes

Metric Target Result

Master Reconvergence < 5mins Av. 51s

Remote Acquisition < 90s24s (1 hop)

37s (3 hops)

Access Point FailoverManagement connectivity to

GridScape from alternative

Access Point.

Successfullydemonstrated

Wide Area Network &

Dual Master eBridge

Failover

RF Mesh Network re-converges

via other WAN

Successfully

demonstrated

Self-healingProve the resilience and speed

of recovery on the loss of a

Remote eBridge and a Relay.

Successfully

demonstrated

Successful delivery of SDRC 9 3




• Successful Delivery

Reward Criteria (SDRC) –

project milestone agreed

with Ofgem

• Report submitted to

Ofgem on the 28 March

68

Successful delivery of SDRC 9.3

Business-as-Usual




Stakeholder Engagement

Training

Common Practices

Installation

Service Desk

69

Communications solution developed to enable rapid transition to a Business-as-Usual model.

Business as Usual

Key Learning Points




Design and Install

IEC 61850

Firsts

• Increased understanding of how an IP-based communications infrastructure

operates.• Appreciation of site survey criteria to take into account for locating Relays.

• Communications solutions could be flexibly deployed within short timescales.

• Learning on how to set-up support arrangements and a dedicated service desk

function to assist with on-going management.

• New knowledge generated and experience gained on how to implement IEC 61850

trials and using associated tools.

• UK’s first primary and grid level smart grid Radio Frequency Mesh Network

• UK Power Networks’ first deployment using the smart grid standard, IEC 61850, to and

between substations.

• Cable & Wireless Worldwide’s (now Vodafone) first smart grid deployment.

70

Key Learning Points




Next Steps

71






Dave Openshaw





Cyber security design

Tim Manandhar

Contents




• Implications of Cyber security for FPP• Security design Approach

• Communications platform security

Contents

Implications of Cyber security for FPP




Implications of Cyber security for FPP

New hardware and new technology

New architecture and new topology – Smart Grid

Interface to the existing UKPN critical systems

Third party managed services

CPNI good practice guides ISA99/IEC62443

Data centre security standards

FPP security context

Guidelines and Standards

Security Design Approach




Security Design Approach

Resourcing and Planning

Security Design Reviews

Risk Assessment process

Exploring Expertise within the industry

Engaging external expertise – PA Consulting

Identification

Response

Risk mitigation action plan

Implementation and………continuous monitoring

Review of functional design specifications

Identify threat scenarios & enhance security

With UKPN internal stakeholders

Risk Classification: Probability and Impact

Identify actions as per risk rating

Vendor and UKPN action planning

Proactive

Reactive

Monitoring

Interactive

Basic security

model

Structured Approach for FPP security design

1

2

3

4

5

Implementation

Active

Design Review and Risk assessment




Design Review and Risk assessmentIdentify zones

and actors

Define

Information flows

Review Functional

design specifications

Identify threat

scenarios

Communications platform Security




Key security goals for End to End security

Communications platform Security

Key WAN security controls

Industrial defender firewall

VRF (Virtual Routing and Forwarding)

DMZ (Demilitarised zone)

Detect and resist unauthorised traffic

Separation of FPP traffic over dedicated virtual network in WAN

Denial of rogue devices gaining unauthorised access to RF mesh network

Restriction to only specified source/destination IP address and port

Key RF mesh security controls

RF mesh Link Layer security

Application layer firewall Cryptographic authentication and

authorisation






Dave Openshaw




Flexible Plug and PlayNext Steps




Next key milestones

C




Customers update

• 11.25 additional MW in the pipeline to receive FPP offers

Wind Farm 33 kV 11 kV BAU offer FPP Connection Cost

A 0.5 £1.9 m £ 235 k

B 2.5 £2.0 m £157 k

C 1 £2.0 m £ 385 k

D 7.2 £3.5 m £ 880 k

E 10 £4.8 m £ 590 k

F 5 £1.2 m £ 650 k

L i




Learning zone

www.flexibleplugandplay.co.uk

http://www.flexibleplugandplay.co.uk/

http://www.flexibleplugandplay.co.uk/






Dave Openshaw


Documents

FPP_Telecoms_combined+presentations_030613