Performance Evaluation Framework-Report
Performance Evaluation Framework-Report
PERFORMANCE
EVALUATION FRAMEWORK
FOR ELECTRIC BUSES IN INDIA
FINAL REPORT
JULY | 2020
JULY | 2020
2
About Shakti:
Shakti Sustainable Energy Foundation seeks to facilitate India’s transition to a sustainable energy future
by aiding the design and implementation of policies in the following areas: clean power, energy efficiency,
sustainable urban transport, climate change mitigation, and clean energy finance.
Contact: The Capital Court, 104B/2 Left Wing, 4th Floor, Munirka Phase III, New Delhi 110067, Delhi
Tel: +91 11 47474000 | Fax: +91 11 47474043 Website: www.shaktifoundation.in
About UITP:
International Association of Public Transport (UITP) is a non-profit organisation headquartered in Belgium
with a global network of offices, including in Delhi and Bangalore. UITP is the only worldwide platform for
cooperation on public transport, with more than 1,800 members from 100+ countries representing public
transport authorities, operators, policy decision-makers, scientific institutions, and the public transport
supply and service industry. We undertake research, advocacy, and capacity building initiatives and provide
networking platforms to advance public transport systems.
Contact: Ninety Ten Eventures Office Space, F-322, Lado Sarai, New Delhi 110030, Delhi
Website: www.uitp.org
Authors:
Christy Ann Cheriyan
Ravi Gadepalli ([email protected])
Rupa Nandy ([email protected])
Acknowledgements
We would like to thank Mr. Aman Garg from Foton-PMI, Mr. Naga Satyam from Olectra-BYD and other
industry representatives for their valuable feedback and insights, which helped improve the report. We would
also like to thank Ruchir Shukla, Vivek Chandran and Chetna Nagpal from Shakti Foundation for their critical
inputs during project design and report development.
Disclaimer:
The views/ analysis expressed in this report/ document do not necessarily reflect the views of Shakti Sustainable
Energy Foundation. Furthermore, the Foundation does not guarantee the accuracy of any data included in
this publication or accept any responsibility for the consequences of its use.
Contents
Abbreviations................................................................................................................................................................ 5
1. Introduction.................................................................................................................................................... 7
1.1 Electric buses in India: the story so far...........................................................................................................7
1.2 Need for e-bus performance evaluation framework....................................................................................7
1.3 Project background.......................................................................................................................................... 8
1.4 Report outline................................................................................................................................................... 9
5. Way forward..................................................................................................................................................32
6. Annexures.....................................................................................................................................................33
6.1 Annexure I: CIRT data indicator list............................................................................................................33
6.2 Annexure II: Indicators identified in global review.....................................................................................39
6.3 Annexure III: Detailed framework for proposed e-bus performance evaluation...................................41
List of Tables
Table 1 Documents reviewed on global practices....................................................................................................14
Table 2 Comparison of global e-bus performance evaluation approaches..........................................................15
Table 3 Data collection methods and periodicity in global performance evaluation........................................... 17
Table 4 Overview of current e-bus fleets in India*.................................................................................................19
Table 5 Essential e-bus performance evaluation indicators.................................................................................. 21
Table 6 Recommended e-bus performance evaluation indicators..................................................................... 23
Table 7 New Indicators to be collected from schedule-wise charging reports.................................................. 27
Table 8 New Indicators to be collected from DISCOMs/ related sources........................................................ 27
Table 9 New Indicators to be collected from OEM/operator invoices to government entities...................... 27
Table 10 Indicators to be collected by the STU/Contracting Authority.............................................................28
Table 11 Indicators to be collected by the operator............................................................................................... 29
Table 12 Indicators to be collected by OEMs........................................................................................................30
List of Figures
Figure 1 Application of performance evaluation framework.................................................................................. 12
Abbreviations
kL kilolitre
km kilometre
KMPL kilometre per litre
KPI Key Performance Indicator
KSRTC Kerala State Road Transport Corporation
kV kilo-volt
kWh kilowatt-hour
LCTSL Lucknow City Transport Service Limited
LEB Low Emission Bus
MBTA Massachusetts Bay Transportation Authority
MIS Management Information System
MoRTH Ministry of Road Transport & Highways
NMMT Navi Mumbai Municipal Transport
NREL National Renewable Energy Laboratory
O&M Operation and Maintenance
OEM Original Equipment Manufacturer
OPEX Operational Expenditure
Ps./eff. km Paise/effective km
PTA Public Transport Authority
R/C Reconditioned
R&D Research and Development
SLA Service Level Agreement
SoC State of Charge
SPV Special Purpose Vehicle
sq km square kilometre
SSEF Shakti Sustainable Energy Foundation
STU/SRTU State Transport Undertaking/State Road Transport Undertaking
TCO Total Cost of Ownership
TfL Transport for London
TRL Transport Research Laboratory
TRW Transport Research Wing
UITP International Association of Public Transport
US United States
ZEB Zero-Emissions Bus
1. Introduction
1.1 Electric buses in India: the story so far 1.2 Need for e-bus performance
Electric buses (e-buses) in India have a relatively short evaluation framework
history. The Faster Adoption and Manufacturing The introduction of e-buses is ushering in a new era of
of Hybrid and Electric Vehicles (FAME) scheme, bus service provision in India. First, e-buses themselves
launched by the Government of India (GoI) in are an expensive new technology that varies significantly
2015 to accelerate India’s transition from fossil in operations, planning, and maintenance compared to
fuel-based vehicles to zero-emission vehicles, kick- internal combustion engine (ICE) buses. Cities are yet
started the adoption of electric buses. The scheme to identify the best-fit e-bus technologies for their
provides financial incentives for electric vehicle operating conditions. Even as more electric buses
(EV) purchase, charging infrastructure deployment, are being deployed, it is important to evaluate the
and research and development (R&D). The FAME performance of already deployed e-buses to improve
I scheme sanctioned a total of 390 e-buses to be their operational performance and inform future
deployed across 11 cities. At the end of FAME-I, in procurement choices. In addition to the technology
April 2019, GoI announced the second phase of the switch, many bus agencies are also witnessing a
scheme. The FAME II scheme is being rolled out change in business models. Many STUs, responsible
with an outlay of Indian Rupee (INR) 10,000 crores for public bus operations in India, have traditionally
spread over three years, i.e. Financial Year (FY) 2019- owned and operated their buses. However, they are
20 to FY 2021-22, to provide demand incentives moving towards the Gross-Cost Contract (GCC)
for EVs. Thirty-five percent of the total FAME II procurement model under FAME-II, wherein the
scheme outlay is allocated to e-bus procurement in technology risk and investment for the buses is covered
cities. For this, the Department of Heavy Industries by the service provider, while the contracting authority
(DHI) has selected 64 cities across India to receive takes responsibility for service planning and delivery
financial incentives for the deployment of 5,595
and the revenue risk. Performance monitoring of
e-buses. In addition to the FAME scheme, urban
service providers is crucial to ensuring the transparent
bus providers in Ahmedabad, Pune, and Bangalore
functioning of GCC operations.
and State Transport Undertakings (STUs) like
Himachal Road Transport Corporation (HRTC)
are also procuring e-buses through
independent efforts.
In this context, a data-driven performance evaluation timely inputs to improve the efficiency of e-bus
framework for e-buses can help Indian bus agencies service delivery.
meet the following objectives:
DHI has already created the necessary ecosystem for
• Technology evaluation to inform future such a national performance evaluation framework,
procurement: Develop a comprehensive mandating that all agencies receiving the FAME-II
understanding of the performance of different subsidy create an online platform for performance
e-bus technologies under varying operating monitoring and data sharing. However, specific
conditions and business models, which can be actions have not yet been taken to operationalise the
used to define decision-making criteria for future performance monitoring platform.
procurement and, at the same time, inform OEMs
on vehicle technology improvement needs. This report fills in the gap in the available literature
to provide guidance to contracting authorities and
• Peer to peer learning to improve deployed service providers deploying e-buses on how to
buses’ performance: Facilitate peer to peer evaluate their performance across different vehicle
learning across cities through standardised data and charging technologies, business models, and
management and sharing practices. This will help operating conditions.
them adopt the best operational practices for the
available e-bus technologies, thereby increasing
1.3 Project background
the e-bus lifespan and improving battery and
charging infrastructure performance. International Association of Public Transport (UITP),
with support from Shakti Sustainable Energy
• Monitoring operations and contract Foundation (SSEF), has undertaken a project on
management: Review e-bus operator “Creating enabling mechanisms to scale-up adoption
performance against the Service Level of electric buses in Indian cities”. The project focused
Agreements (SLAs) listed in their contracts to on providing knowledge support on financial incentives
ensure the success of the contract and provide and alternative approaches for e-bus procurement.
1
Measuring public transport performance, Lessons for Developing Countries, SUTP Technical Document #9, GIZ
2
Uptime refers to the ratio of the total operational time of a piece of equipment to the total available time.
Figure 1: summarises the key applications of performance evaluation, use cases, and stakeholders benefitted.
Contracting
Stakeholders Policy makers Operators
authorities
• Incentive
• Service planning
design • Procurement Fleet and
and delivery
Use cases • Emission • Financial battery
• Training and management
reduction planning
capacity building
estimation
In this study, the various global examples of e-bus (MBTA)may be carrying out more comprehensive
performance evaluation and current practices in performance evaluation, only the publicly available
India were reviewed to extract learnings to inform data analysed in the current project is covered in this
the development of an India-specific e-bus report.
performance evaluation framework.
The following sub-sections present the review
of the international practices described in the
3.1 Global practices abovementioned documents, covering their strategic
Globally, around 0.42 million (4.2 lakh) e-buses are priorities, data collection methods, and performance
operational, 99% of which are in China. It is expected evaluation indicators.
that this number will increase to around 18 million by
2020 (BNEF, 2018). China, Europe, and the United 3.1.1 Performance evaluation agencies and objectives
States (US) are the three regions with the largest Globally, e-bus performance evaluation is mainly
e-bus fleets. A detailed review of the performance commissioned by transit authorities and government
evaluation mechanisms adopted in these regions agencies, as well as independent entities in many
is presented in this section. A brief overview of cases. In Europe and the US, government entities
documents reviewed for this project is given in such as Transport for London (TfL) and Federal Transit
Table 1. While the transit agencies in certain cities Administration (FTA) Research commissioned
in these regions such as Transport for London (TfL) studies to provide guidance on future procurement
and Massachusetts Bay Transportation Authority and evaluate e-bus performance against the set
1 China Sustainable Transport Solutions: Low Carbon Asian Development Bank 2018
Buses in the People’s Republic of China (ADB)
targets. In Shenzhen, China, performance evaluation authority commissioning the evaluation. The major
was undertaken by the Asian Development Bank, in objectives of e-bus performance evaluation globally
association with Shenzhen Urban Transport Planning are the following:
and Design Institute. ADB also conducted an
independent evaluation in partnership with Grutter, • To estimate the emission reductions from
covering multiple Chinese cities with large-scale e-buses- The performance evaluation of e-buses
fleet operations. Most of these studies focused on in Chinese cities focused on this aspect.
a specific city. Independent evaluation studies in
China were not as comprehensive as the reviews • To evaluate the e-bus TCO- US cities conducted
commissioned by public authorities in Europe and e-bus performance evaluation to estimate the
the US. TCO, in order to develop further deployment
strategies.
A summary of the strategic objectives, scale, and
timelines of the performance evaluation initiatives • To identify training and capacity building
is given in Table 2. These aspects varied across the needs- Chinese and US cities also conducted
cases reviewed according to their applications. In performance evaluation to identify training and
terms of objectives, while financial performance and capacity building requirements.
cost implications were evaluated in all the studies,
the evaluation in London also included user feedback
• To assess scope for further improvement in
e-buses: All the reviewed entities conducted
and perception on e-buses. The duration of the
performance evaluation in part to identify
evaluations also varied significantly amongst the
room for further improvement. The key areas
cases, with London having the longest duration, as
of improvement include operational planning,
the project started in 2017 and is still under way.
infrastructure procurement, and deployment
The applications of performance evaluation also strategies, real-world e-bus performance,
varied based on the strategic objective of the operations, and technology.
3.1.2 Performance evaluation indicators and range in each operating scenario. In full-
All the reviewed cases entailed very comprehensive fledged performance evaluations carried out over a
data collection, including documentation of the longer period, data variation across time period and
baseline scenario through data collection on bus temperature were also analysed. Cities in the US
system characteristics and infrastructure facilities. also conducted an in-depth analysis of breakdowns
The major categories of data collection included: and bus availability to assess e-bus reliability. Energy
consumption and driving range was collected in all
1. Bus system details reviewed cases, as this data is needed to calculate
a. Bus specifications energy consumption per km.
b. Infrastructure
The detailed breakup of both the initial CAPEX and
c. Operations and energy OPEX were collected in all cases. US performance
evaluations included collection of detailed
2. Funding and financials maintenance data to compare the associated cost
a. Investment cost with that of ICE buses and determine the reasons for
b. Financials e-buses’ higher initial maintenance cost. The work
order maintenance cost was also analysed in US
c. Operation and maintenance (O&M) costs
cities to estimate each e-bus vehicle part’s related
3. Other indicators cost of operations.
a. Attitude and perception Two additional parameters collected across the
b. Driver satisfaction reviewed cases were user and driver satisfaction and
the ability of the organisation to deliver high-quality
Bus specifications and infrastructure details are bus services based on its previous experience with
captured at the beginning of the evalutation, as it is zero-emissions buses (ZEBs). Inclusion of these
important to analyse the baseline information. Bus parameters indicates a comprehensive approach to
operations data collected included route details, evaluation of e-bus service delivery, capturing the
daily driving range in kilometres (km), energy perception of end-users and service operators. The
consumption, etc. These indicators can provide summary of performance evaluation indicators is
insights into e-bus reliability, battery performance, given in Annexure II.
3.1.3 Data collection methods and periodicity 2. The major applications for which performance
The reports published by independent agencies and evaluation was conducted include:
authorities are based on the collaborative efforts of a. Emission reduction estimation
different stakeholders. In most cases, the agency that b. TCO estimation
conducted the performance evaluation collected
c. Identification of training and capacity building
the data from manufacturers, operators, and users.
needs
Except for Chinese cities, where the data collection
was a one-time exercise, the other studies involved d. Identification of scope for further operational
frequent data collection. In most cases, the data improvement
collection was based on transit agencies’ current
monitoring practices, and these agencies/authorities 3. Transit agencies, bus operating companies, and
already had an extensive performance evaluation manufacturers need to collaborate to ensure
mechanism in place. data availability in order to facilitate efficient data
collection in the evaluation.
Furthermore, the data was collected from multiple
sources, including telematics, utility bills, activity 4. In the majority of reviewed cases, performance
sheets, etc. An overview of the data collection evaluation data was collected from standard data
methods and periodicity is given in Table 3. logs maintained by transit agencies, instead of
3.1.4 Key learnings from global practices through surveys or other evaluation-specific
The key learnings from the review of global practices collection campaigns.
are summarised below:
5. The key categories of performance evaluation
1. Initiation of e-bus performance evaluation by indicators adopted globally are:
decision-makers like transit authorities or other a. Bus system details
government agencies is a key feature of the more
i. Bus specifications
comprehensive evaluations.
3
M Jain, M., Jain, H., Tiwari, G. & Rao, K.R. (2016) Indicators to Measure Performance Efficiency of Bus Systems. Final Report. Prepared for Shakti
Sustainable Energy Foundation, New Delhi. TRIPP-PR-16-02. Transportation Research and Injury Prevention Programme, Indian Institute of Tech-
nology Delhi.
3.2.2 Data collection methods and periodicity operations, the frequency of data collection may
The annual reports published by CIRT are based on also depend on the frequency of payment, which
the data supplied by the STUs on a quarterly basis is typically linked to KPIs. Performance evaluation
in a predefined format. The data is collected from practices of Indian e-bus operators
approximately 53 reporting STUs and SPVs across
India currently has about 600 e-buses, out of
the country, which includes both urban and rural
which 560 can be considered public transport fleets
services. One challenge is that most SPVs are not
(i.e. at least 10 buses per fleet) deployed by 11 bus
part of the regular data collection process. Therefore,
agencies, as presented in Table 4. While 385 of
the annual compilation by CIRT or the Transport
these were procured through GCC, a total of 175
Research Wing (TRW) only includes evaluation of
buses in Lucknow, Kolkata, Jammu and Kashmir, and
data from the reporting STUs and a few SPVs.
Guwahati were procured through outright purchase
using the FAME I subsidy. While these agencies
3.3 Performance evaluation practices of continue to collect bus operations related KPIs such
as fleet availability, vehicle utilisation, and punctuality,
Indian e-bus operators e-bus technology-specific KPIs such as energy
STUs typically monitor their operational performance consumption, charger and battery performance, etc.
schedule-wise at a depot level. This data is compiled are not captured in great detail. Most agencies just
at the STU level for submission to CIRT. The collect the electricity consumption data across all the
typical operational information, i.e. Management buses, without measuring bus, charger, and route–
Information System (MIS) data, is collected through wise performance. Hence, Indian bus agencies need
manual methods or an Intelligent Transport System to improve their performance evaluation practices
(ITS) in the case of advanced STUs. The O&M to track their own e-bus performance and compare
data at the depot level are collected on a daily basis, themselves with other agencies. A standardised set
whereas financial performance indicators are typically of KPIs across agencies can improve operational
collected on a monthly basis. In the case of outsourced efficiency and inform future procurement decisions.
A performance evaluation framework for e-buses indicators specific to electric buses that all e-bus
in India is presented in this chapter, based on the implementing agencies are advised to collect to
best practices from current bus performance ensure successful operations, whereas Stage 2
evaluation in India and the review of international incorporates the essential indicators within a broader
examples. This section discusses the strategic intent set of indicators that cover the overall operational and
of performance evaluation, proposed indicators, and financial performance of the bus system, in addition
the possible data collection methods and sources to just evaluating the e-bus specific indicators.
for these indicators. Further details on the specific These are termed as ‘recommended indicators’
stakeholders to be in charge of data collection, data that can make the evaluation more comprehensive.
sources, etc. have been detailed in Annexure III. Both essential and recommended indicators can be
Real-time performance monitoring is a continuous generated by most traditional/ manual methods of
effort that involves continuous tracking of KPIs, data collection, as well as from advanced ITS/ MIS.
which, in turn, requires an efficient Intelligent
Transport System for buses.
4.1 Proposed e-bus performance evalua-
As discussed in Chapter 2, many Indian states and tion indicators
cities have poor data management and ITS practices
The proposed indicators for electric bus performance
that prevent them from carrying out effective
evaluation are categorised into:
real-time performance monitoring. In these cases,
periodic performance evaluation of the identified a. Bus system details
KPIs should be taken up in simple spreadsheet/
excel based templates as a first step, even in cities i. Bus specifications
without ITS and real-time monitoring systems. ii. Infrastructure
Hence, this chapter explains performance evaluation iii. Operations
assuming there is periodic, as opposed to real-time,
iv. Energy
data collection. The same indicators can easily be
incorporated into real-time monitoring systems v. Personnel
where available. Furthermore, these indicators are b. Funding and financial indicators
presented in two stages: Stage 1 comprises essential
c. Other indicators
i. User attitude and perception
Table 6 presents the ‘recommended indicators’ for collected. The main new indicators proposed
e-bus performance evaluation, which expand on the include those related to charging infrastructure
‘essential indicators’ covered in Table 5. It includes specifications, energy consumption, and financing
a total of 57 Key KPIs identified to monitor and patterns for new procurement models. The detailed
evaluate e-bus performance. The bus system details, definition of each indicator and any associated
manpower, infrastructure component, and bus formula is given in Annexure II.
operations include CIRT indicators that are typically
6 Wheelbase
7 Passenger capacity
8 Rated power (Horse Power
(HP))
II. INFRASTRUCTURE SPECIFICATIONS
9 Charger description
10 Total no. of chargers
11 Capacity of depot charging Capacity provided at the depot
infrastructure (kW)
12 Capacity of enroute charging
facility (if any) (kW)
13 Power supply to the depot (kV)
14 Number of e-bus depots
15 No. of e-buses per depot
16 Total depot land area available Specified as land per depot
(sq km)
III. Operations
17 Average number of on-road
buses
18 No. of operational days per
month
19 Scheduled km per bus per day
20 Dead km per bus per day Average dead km across all routes
21 Operated km per bus per day Average operated km across all
routes
22 Average odometer reading
23 Steering hours per bus per day Total operational hours of the bus
including break times
53 Source of subsidy
56 Loan tenure
4
https://shaktifoundation.in/wp-content/uploads/2016/07/Indicators-to-measure-performance-efficiency-of-bus-systems1.pdf
The abovementioned indicators need to be monitored indicators related to personnel and financing based
by the authority at a certain frequency, for which on the procurement model, utility bills, etc. need to
the data needs to be collected either daily, monthly, be collected on a monthly basis, as these data are
or at the beginning of the evaluation. Accordingly, typically provided at the end of each month. The
all indicators are classified based on the periodicity detailed framework of indicators given in Annexure III
of data collection. The bus system details and mentions the periodicity for each indicator.
infrastructure indicators only need to be collected
at the beginning of evaluation, as they should largely
remain constant. The bus operations details and 4.3 Responsibility for data collection
energy indicators need to be collected on a daily The involvement of different stakeholders in the
basis, as these data indicators vary with respect to performance evaluation depends on the type of
the specific daily operating conditions. Finally, certain procurement model. The key stakeholders include:
To summarise, e-bus performance evaluation to be compared with those of other cities and states
requires a multi-stakeholder approach to ensure to benchmark their performance. In addition to
comprehensive data collection and fulfil the helping cities with their operational strategies, such
objectives of all stakeholders. The detailed proposed benchmarking will also support DHI in evaluating the
performance evaluation framework is given in performance of e-bus funding through the FAME
Annexure III. scheme and designing future subsidies to encourage
the best-performing systems.
4.4 National e-bus data-sharing platform Given the benefits of adopting a pan-India
The KPIs proposed for e-bus performance evaluation framework, it is recommended that DHI support
need to be calculated based on data collected from the development of a common platform to track the
multiple sources, as listed in Section 4.2, and by progress of e-bus implementation across the country
multiple stakeholders, as listed in Section 4.3. and benchmark e-bus performance. The following
Furthermore, the performance evaluation needs to are the key points to consider when developing such
be carried out by each city/ state, and the KPIs needs a platform:
1) Learning from the current performance and MIS/ excel data input based performance
monitoring platforms evaluation, to ensure that it can be adopted by
• Performance monitoring of conventional ICE all states and cities, regardless of their level of
technology access in their operations.
buses is currently carried out using a combination
of ITS and MIS based platforms
• As an interim step towards developing a national
• The existing ITS and MIS systems in India are ITS/ MIS platform, it is recommended that a
simple spreadsheet/ excel based data sharing
typically driven by the vendors providing the
software service or those deploying the ITS template be circulated among cities implementing
hardware. As a result, most Indian cities do not e-buses. The template can adopt the framework
have an integrated ITS and MIS platform that proposed in this report.
helps them monitor their overall performance. • The national platform can initially compile and
• One of the key reasons for the lack of a
compare e-bus performance data across cities
based on an excel-based data collection template.
comprehensive solution in India is that each
Once the excel-based performance monitoring
city has tried to develop its own platform, even
mechanism has been rolled out across India and
though they do not always possess the required
is operating smoothly, the platform can transition
technical and financial resources that are needed
to more advanced methods like MIS and ITS.
for such a system.
3) Venue for national performance monitoring
2) Need and scope for the proposed national platform
platform development and management
• Developing a national platform can help pool • Consistent efforts to develop and sustain the
resources centrally to develop a good quality
national e-bus performance monitoring platform
solution that works across all states and cities.
are of paramount importance to ensure its
• The performance evaluation framework proposed successful deployment and accrue the benefits
in the previous sections is designed to cover both of the platform.
technology-related performance indicators like
energy efficiency, charging time, range, and
• It is recommended that GoI backed centres of
excellence such as CIRT, Automobile Research
breakdowns and other indicators covering operations,
Association of India (ARAI), or the International
user perception, and funding and financing.
Centre for Automotive Technology (ICAT),
• Hence, the proposed national platform can either Manesar are entrusted with the responsibility of
be designed as a part of the wider public bus developing and maintaining the platform, with
performance monitoring efforts or with a specific support from external agencies such as UITP,
focus on e-bus-specific performance evaluation International Council on Clean Transportation
indicators. (ICCT), or consulting firms specialising in the topic.
These agencies have the technical competence to
• It is recommended that the platform cater to both adopt both the excel-based monitoring and the
ITS based real-time performance monitoring more advanced MIS/ ITS systems.
5. Way forward
Electric bus implementation has been initiated methods in case the agency does not have access to
through the FAME I scheme and has now picked up MIS/ ITS systems.
momentum through FAME-II and various state-
level initiatives focused on promoting clean mobility 3. Develop a national e-bus data sharing platform: A
technologies. As cities selected for the FAME II subsidy national data sharing platform needs to be established
and others prepare for the deployment of e-buses, it to help cities implement the proposed performance
is important to ensure that they have a framework for evaluation framework, so that they can quickly adopt the
carrying out comprehensive performance evaluation system instead of developing one on their own, and DHI
to improve their implementation efficiency and inform can efficiently monitor the performance of e-buses
future procurement efforts. To this end, this report subsidised under the FAME scheme. The platform
presented potential applications of e-bus performance should be maintained by agencies such as CIRT, ARAI,
evaluation, performance evaluation indicators, and an or ICAT, which can quickly build the technical skillsets
overall framework for data collection and performance needed for such a platform. A unified platform will help
evaluation. in standardising data management and sharing protocols,
even as the scale of e-bus implementation at the city
It is important to include e-bus specific KPIs in existing level progresses from pilots to fleet level deployment.
institutional mechanisms to ensure a smooth transition Initially, this platform can use simple excel-based
to e-bus performance evaluation. This can be done by data management templates to ensure its widespread
retaining the KPIs from ICE buses for operational and adoption and then gradually introduce more advanced
financial indicators, while adding in e-bus-specific KPIs MIS and ITS based data sharing protocols.
such as energy consumption and battery and charging
infrastructure performance. 4. Institutionalise performance evaluation in STUs:
The proposed performance evaluation framework
Furthermore, implementing agencies and policy needs to be integrated into the STUs’/authorities’
makers need to ensure that data is collected continuous monitoring activities to learn from previous
effectively. Accordingly, the following next steps are experiences and improve operational strategies. This
recommended to help Indian cities benefit from the entails incorporating e-bus-specific KPIs, such as e-bus
proposed performance evaluation framework: energy efficiency (kWh/km), charging duration, related
off-time, etc., into their conventional performance
1. Incorporate the proposed performance evaluation evaluation mechanisms.
framework into the DHI guidelines for STUs/ city
authorities deploying e-buses. DHI has already 5. Knowledge sharing and capacity building
proposed e-bus performance evaluation in its programmes: As STUs and cities gain experience in
Expression of Interest (EoI) inviting cities to undertake e-bus deployment and operations, there need to be
e-bus operations. Therefore, the framework proposed opportunities for them to exchange knowledge and
in this report and the detailed steps outlined for the learn from each other’s experiences. In parallel, capacity
adoption of performance evaluation by respective building programmes exposing them to the latest
implementing agencies can form the basis for the data trends in e-bus technologies, planning, procurement,
sharing mandated by DHI. and management will ensure the sustainability of their
operations and facilitate further scale-up.
2. Pilot the proposed e-bus performance evaluation
framework in cities that have already deployed 6. Integrate the new e-bus performance evaluation
e-buses. This can be carried out in partnership with the indicators into CIRT and TRW frameworks. The
STU, OEM, and operator involved to test the validity proposed framework includes new indicators necessary
of the developed framework and build the capacity for e-bus performance evaluation; these indicators
of all the stakeholders in order to make performance should be incorporated into the CIRT and TRW
evaluation a core part of their operations and future frameworks. This will ensure that STUs/authorities
decision-making. The pilot can be based on simple data collect e-bus indicators for their annual reporting to
collection processes using manual and excel-based CIRT and TRW.
6. Annexures
Indicator Unit
Financial Performance
Indicator Unit
Physical Performance
Indicator Unit
Indicator Unit
Indicator Unit
Gearbox oil
i. Top-up kL
ii. Oil change
Springs kg/lakh km
Retreaded tyres consumed Units/lakh km
Differential oil
i. Top-up L
ii. Oil change
Engine life
i. New
a. Tata
b. Leyland
c. Volvo
d. Others
Lakh km
ii. Reconditioned (R/C)
a. Tata
b. Leyland
c. Volvo
d. Others
iii. Overall
Crown wheel & pinion life
i. Tata
ii. Leyland
Lakh km
iii. Volvo
iv. Others
v. Overall
Fuel injection pump life
i. New
a. Tata
b. Leyland
c. Volvo
d. Others
Lakh km
ii. R/C
a. Tata
b. Leyland
c. Volvo
d. Others
iii. Overall
Indicator Unit
Gearbox life
i. New
a. Tata
b. Leyland
c. Volvo
d. Others
Lakh km
ii. R/C
a. Tata
b. Leyland
c. Volvo
d. Others
iii. Overall
i. Tata
ii. Leyland
Lakh km
iii. Volvo
iv. Others
v. Overall
i. Tata
ii. Leyland
Lakh km
iii. Volvo
iv. Others
v. Overall
Infrastructure - Charging - Infrastructure type - Charging type & location - Charging type &
typology - Breakdown time - Maintenance facilities location
- Power stations - Reason for breakdown - Vehicle parking and storage - Maintenance facilities
- Time to repair facilities - Vehicle parking and
storage facilities
Financials - Bus and - Infrastructure unit - Bus purchase cost - Bus purchase cost
infrastructure operating costs - Labour cost - Labour cost
investment - Scheduled maintenance cost - Scheduled maintenance
costs per km cost per km
- Energy cost - Unscheduled maintenance - Unscheduled
- Staff cost cost per km maintenance cost per
- Spare part cost - Work order maintenance cost km
- Service per km - Work order maintenance
charges cost per km
- Investment,
charger O&M
cost
- Maintenance
cost
Other indicators - Risks and - Attitude towards and - Previous experience with
indirect costs perception of low ZEBs
- User and driver emission buses - Roles of organisations
satisfaction - Ease of integrating bus - Driver, fleet personnel,
and infrastructure with and customer
the current fleet perceptions
- Ease of O&M - Special fleet needs
- Perception of bus and - Training
infrastructure as a
whole
6.3 Annexure III: Detailed framework for proposed e-bus performance evaluation
Evaluation metric Sub-metric Data Agency for Data collection Data Data Analysis
already collection source and collection applications required
captured in GCC method periodicity
(CIRT) model
or new?
Name of the CIRT STU STU/Authority Once -
OEM Fleet database
Total number of CIRT STU STU/Authority Once Incentive design Pan-India
buses Fleet database compilation
to decide
No. of 9m CIRT STU STU/Authority Once Incentive design on future
buses Fleet database incentives
No. of 12m CIRT STU STU/Authority Once Incentive design
buses Fleet database
Date of induction CIRT STU STU/Authority Once -
of buses Fleet database
Length/width/ CIRT STU, from STU/Authority Once Incentive design
height OEM Fleet database
/ OEM product
portfolio
Gross Vehicle CIRT STU, from STU/Authority Once
Weight OEM Fleet database/
OEM product
portfolio
Wheelbase CIRT STU, from STU/Authority Once
OEM Fleet database/
OEM product
portfolio
Passenger capacity CIRT STU, from STU/Authority Once
OEM Fleet database/
OEM product
portfolio
Rated power (HP) CIRT STU from STU/Authority Once
OEM Fleet database/
OEM product
portfolio
Charger new OEM STU/Authority Once Service planning Evaluation
description Electrical and delivery; of the
database/OEM fleet and battery operational
product portfolio management suitability of
a particular
Total no. of new OEM STU/Authority Once Service planning charging
chargers Electrical and delivery; technology
database/OEM fleet and battery
product portfolio management
Capacity of new OEM STU/Authority Once Service planning
depot charging Electrical and delivery;
infrastructure database/OEM fleet and battery
(kW) product portfolio management
Capacity of new OEM STU/Authority Once Service planning
enroute charging Electrical and delivery;
facility (if any) database/OEM fleet and battery
(kW) product portfolio management
Power supply to new OEM STU/Authority Once Service planning
the depot (kV) Electrical and delivery;
database/OEM fleet and battery
product portfolio management
Evaluation metric Sub-metric Data Agency for Data collection Data Data Analysis
already collection source and collection applications required
captured in GCC method periodicity
(CIRT) model
or new?
Number of e-bus new STU STU/Authority Once Total cost of
depots Database ownership
estimation;
procurement
and financial
planning
No. of e-buses per new STU MIS/ITS Once TCO estimation;
depot procurement
and financial
planning
Total available CIRT STU STU/Authority Once TCO estimation;
depot land area Database procurement
(sq km) and financial
planning
Average number CIRT STU MIS/ITS Monthly Service planning
of on-road buses and delivery
No. of operational CIRT STU MIS/ITS Monthly Service planning 1. Percentage
days per month and delivery of cancelled
km against
Scheduled km per CIRT STU Schedule Daily Service planning scheduled
bus per day Database and delivery km, to be
Dead km per bus CIRT STU MIS/ITS Daily Service planning used in future
per day and delivery scheduling
(reasons for
Operated km per CIRT Operator MIS/ITS Daily Service planning cancellation
bus per day and delivery to assess the
nature of
Average odometer CIRT Operator MIS/ITS Monthly Service planning repetition)
reading and delivery 2. Planning
Steering hours per CIRT Operator MIS/ITS Daily Service planning for future
bus per day and delivery maintenance
for a particular
Scheduled CIRT STU STU/Authority Daily Service planning bus type
revenue hours per Schedule and delivery and specific
bus operating
conditions
Time spent at a CIRT Operator MIS- Operations/ Daily Service planning 3. Assessment
depot per bus per ITS and delivery of the battery
day health, to
Total cancelled km Operator MIS- Operations/ Monthly Service planning predict the
so far ITS and delivery actual range
of buses in real
due to staff new Operator MIS- Operations/ Monthly Service planning time
shortage ITS and delivery
due to bus new Operator MIS- Monthly Service planning
unavailability Maintenance and delivery
due to bus new Operator MIS- Monthly Service planning
breakdown Maintenance and delivery
during
operations
due to traffic new Operator MIS- Operations/ Monthly Service planning
congestion ITS and delivery
due to new Operator MIS- Operations/ Monthly Service planning
transmission ITS and delivery
issues
Evaluation metric Sub-metric Data Agency for Data collection Data Data Analysis
already collection source and collection applications required
captured in GCC method periodicity
(CIRT) model
or new?
due to new Operator MIS- Monthly Service planning
charging Maintenance and delivery;
issues fleet and battery
management
due to battery new Operator MIS- Monthly Service planning
issues Maintenance and delivery;
fleet and battery
management
due to new Operator MIS- Monthly Service planning
electric drive Maintenance and delivery;
issues fleet and battery
management
due to other new Operator MIS- Monthly Service planning
reasons Maintenance and delivery;
fleet and battery
management
Time interval new OEM MIS- Monthly
between Maintenance
maintenance
events
Total number of CIRT Operator MIS- Monthly Service planning
bus breakdowns Maintenance and delivery;
fleet and battery
management
No. of routes CIRT STU Schedule Once Service planning 1.
Database and delivery Identification
of constraints
Average route CIRT STU Schedule Once Service planning along
length Database and delivery; particular
procurement route based
and financial on a particular
planning technology.
Buses per route new STU Schedule Once Service planning This will also
Database and delivery help in future
selection of
Stops per route new STU MIS-Operations/ Once Service planning routes and
ITS and delivery depots, e-bus
scheduling,
Trips per route new STU Schedule Once Service planning and
Database and delivery assessment of
Average speed new Operator GPS Daily Service planning the need for
and delivery opportunity
charging.
Average e-bus CIRT STU MIS-Operations/ Daily Service planning
Load Factor ITS and delivery
e-bus energy new Operator/ Power consumed Monthly Service planning 1.
efficiency (kWh/ OEM by all chargers and delivery; Identification
km) from electric TCO estimation; of the range of
meter readings procurement buses in actual
over the total km and financial operating
covered planning conditions
2. Estimation
of the energy
cost for future
financial
planning
Evaluation metric Sub-metric Data Agency for Data collection Data Data Analysis
already collection source and collection applications required
captured in GCC method periodicity
(CIRT) model
or new?
No. of charging new OEM MIS- Operations/ Daily Service planning 1. Estimation
cycles per day ITS and delivery; of the actual
fleet and battery steering
management hours in the
operating
Charging 1 new OEM ITS/Schedule- Daily Service planning
scenario,
duration wise charging and delivery;
to facilitate
reports fleet and battery
e-bus
management
scheduling
SoC at start new OEM Battery SoC- Daily Service planning based on
of Charging 1 Schedule-wise and delivery; range and
charging reports fleet and battery charging
management requirements
SoC at end of new OEM Battery SOC- Daily Service planning 2. Evaluation
Charging 1 Schedule-wise and delivery; of the cost of
charging reports fleet and battery energy and
management extra fleet
required to
Distance new OEM ITS/Schedule- Daily Service planning cover the
travelled for wise charging and delivery; time lost in
Charging 1 reports fleet and battery charging and
(km) management; estimation of
TCO estimation TCO
Charging 2 new OEM ITS/Schedule- Daily Service planning
duration wise charging and delivery;
reports fleet and battery
management
SoC at start new OEM Battery SoC- Daily Service planning
of Charging 2 Schedule-wise and delivery;
charging reports fleet and battery
management
SoC at end of new OEM Battery SoC- Daily Service planning
Charging 2 Schedule-wise and delivery;
charging reports fleet and battery
management
Distance new OEM ITS/Schedule- Daily Service planning
travelled for wise charging and delivery;
Charging 2 reports fleet and battery
(km) management;
TCO estimation
Charging 3 new OEM ITS/Schedule- Daily Service planning
duration wise charging and delivery;
reports fleet and battery
management
SoC at start new OEM Battery SoC- Daily Service planning
of Charging 3 Schedule-wise and delivery;
charging reports fleet and battery
management
SoC at end of new OEM Battery SoC- Daily Service planning
Charging 3 Schedule-wise and delivery;
charging reports fleet and battery
management
Distance new OEM ITS/Schedule- Daily Service planning
travelled for wise charging and delivery;
Charging 3 reports fleet and battery
(km) management;
TCO estimation
Evaluation metric Sub-metric Data Agency for Data collection Data Data Analysis
already collection source and collection applications required
captured in GCC method periodicity
(CIRT) model
or new?
Power consumed new OEM Depot electric Daily Service planning
per day meter reading and delivery;
fleet and battery
management;
TCO estimation
Energy cost (INR new STU DISCOM website Once TCO estimation;
per kWh) procurement
and financial
planning
No. of drivers CIRT Operator MIS-Operations/ Daily Service planning
ITS and delivery;
fleet and battery
management;
TCO estimation
No. of conductors CIRT STU STU/Authority Daily Service planning
Database and delivery;
fleet and battery
management;
TCO estimation
No. of CIRT OEM MIS-Operations/ Monthly Service planning
maintenance staff ITS and delivery;
fleet and battery
management;
TCO estimation
No. of contract CIRT STU STU/Authority Monthly Service planning
management staff Database and delivery;
fleet and battery
management;
TCO estimation
No. of other staff CIRT STU STU/Authority Monthly Service planning
Database and delivery;
fleet and battery
management;
TCO estimation
Business model new STU STU/Authority Once Incentive design; Assessment
(Outright Database procurement for future
purchase/ GCC) and financial procurement
planning model
selection
If GCC
CPKM new STU GCC contract, Once/ Incentive design; Evaluation
(paid to the Monthly invoice/ Monthly procurement of TCO,
operator payment to the and financial its various
if GCC)/ operator planning; TCO components,
Payment estimation and relative
paid to the CAPEX and
operator OPEX costs
Conductor CIRT STU STU/Authority Monthly Incentive design; to decide on
CPKM Staff cost per km procurement procurement
and financial models,
planning; TCO incentives,
estimation etc.
CPKM CIRT STU STU/Authority Monthly Incentive design;
of traffic Staff cost per km procurement
supervision and financial
staff + admin planning; TCO
staff estimation
Evaluation metric Sub-metric Data Agency for Data collection Data Data Analysis
already collection source and collection applications required
captured in GCC method periodicity
(CIRT) model
or new?
Energy new STU DISCOM Monthly Incentive design;
CPKM electricity bills procurement
and financial
planning; TCO
estimation
If outright
purchase
Cost of bus new STU OEM Invoice Once Incentive design;
purchase procurement
and financial
planning; TCO
estimation
Cost of new STU OEM Invoice Once Incentive design;
charging procurement
infrastructure and financial
(if available) planning; TCO
estimation
Staff CPKM CIRT STU STU/Authority Monthly Incentive design;
Staff cost per km procurement
and financial
planning; TCO
estimation
Maintenance CIRT STU STU/Authority Monthly Incentive design;
CPKM Staff cost per km procurement
and financial
planning; TCO
estimation
Energy new STU DISCOM Monthly Incentive design;
CPKM electricity bills procurement
and financial
planning; TCO
estimation
Subsidy amount (FAME CIRT STU STU/Authority Once Incentive design;
subsidy/ Database procurement
state subsidy and financial
amount) planning; TCO
estimation
Source of subsidy new STU STU/Authority Once Incentive design;
Database procurement
and financial
planning; TCO
estimation
Source of new STU STU/Authority Once Incentive design;
financing beyond Database procurement
subsidy (Eg. and financial
Commercial planning; TCO
loans/ grants/ in- estimation
house budgets)
If loan Loan interest new Operator/ STU/Authority Once Incentive design;
rate OEM Database procurement
and financial
planning; TCO
estimation
Loan tenure new Operator/ STU/Authority Once Incentive design;
OEM Database procurement
and financial
planning; TCO
estimation
e-bus earnings new STU MIS-Operations/ Daily Service planning
per km ITS and delivery;
TCO estimation
JULY | 2020
Rue Sainte-Marie 6, B-1080 Brussels, Belgium | Tel +32 (0)2 673 61 00 | Fax +32 (0)2 660 10 72 | [email protected] | www.uitp.org
© UITP - All rights reserved - Responsible Publisher: Mohamed Mezghani, Rue Sainte Marie 6, B-1080 Brussels, Belgium - Legal deposit: D/2020/0105/47