6.1 Construction of synthetic controls
The key problem in estimating the impacts of this policy change is constructing a counterfactual to represent what prices would have been had retail competition not been introduced. Actual prices should be compared to this counterfactual. Using simple “before and after” comparisons of prices to measure the introduction of retail competition is problematic since energy prices often fluctuate over time for many unrelated reasons.
A simple comparison of the prices of non-profit utilities (and, perhaps, intra-state utilities) in Texas to prices in areas opened to competition is also problematic. Before competition was introduced in parts of Texas, municipal utilities and rural electric cooperatives tended to have low relatively rates. This is perhaps because they paid few government taxes and did not need to earn a profit for shareholders, although the prices charged by municipal systems were often set above cost-of-service to provide transfers to fund city services. Thus, including non-profit systems in a comparison group (as was done by the WSJ and the Texas Coalition for Affordable Power) is questionable. The control group’s lower prices could merely reflect historical differences in prices between groups.
Using prices from a single utility with price levels and patterns resembling the region where retail competition was introduced might be advantageous, if such a utility can be found. Averaging of a group of states with similar pre-restructuring price levels and patterns might be an improvement, but the results will be sensitive to which utilities are included in the control group.
Aiming to transparently produce a better counterfactual, the SC method creates a weighted average of the prices of similar utilities to form the counterfactual.[6] Weights are assigned to each of the candidate control group utilities, based on the similarity of their prices to the pre-restructuring price levels and patterns in the city (in this case) of interest. Additionally, covariates may be included in the SC algorithm to better assess the qualifications of the candidate utilities for membership in the control group and the weight that a control group utility’s prices should be assigned.
Corresponding to our methodology’s first step, Table 4 reports the optimal non-zero weights found via the algorithm of Abadie (2021) for constructing the SC for Houston and Dallas. These weights are based on the regulated rates of the integrated utilities listed in Table 3 and selected characteristics of the utilities in the pre-retail-competition period.
As the construction of the SC is sensitive to the selection of pre-treatment years and the decision of whether to include covariates (Kaul et al., 2021), Table 4 contains Case 1: no covariates and multiple years of pre-restructuring price data. To avoid using “too many” time-series observations to form the SC (Kaul et al., 2021), we limit, after extensive experimentation, the number of pre-retail-competition years to three (1990, 1995, and 1999) for Dallas and five (1990, 1992, 1994, 1995, and 2000) for Houston.
Table 4 also contains Case 2A: covariates and multiple pre-retail-competition years and Case 2B: covariates and single pre-retail-competition year of 2000. These two cases aim to show how the use of covariates and the selection of pre-retail-competition year may affect the comparison between actual prices in Dallas and Houston and counterfactual rates. Informed by Rose et al., (2021), the list of covariates used in Cases 2A and 2B includes (a) state-level data for per capita income, per capita employment, cooling degree days, heating degree days, and shares of coal-fired, natural-gas-fired, hydro, solar, and wind generation; (b) utility-level data for MWh sales and MWh shares by customer class; (c) whether the utility is an investor-owned utility; and (d) whether the utility belongs to a regional transmission organization or independent system operator.
Table 4. Optimal non-zero weights (sum = 1.0) found via the algorithm of Abadie (2021) for constructing the synthetic control of a city in Texas based on the pre-retail-competition period of 1990-2000
Panel A: Dallas
Candidate utility
|
Case 1: No covariates and multiple years of pre-restructuring price data
|
Case 2: Covariates
|
A: Multiple years of pre-restructuring price data
|
B: Single year of pre-restructuring price data
|
El Paso Electric Co
|
0.075
|
0.252
|
0.285
|
Florida Power Corp; aka Progress Energy Florida Inc
|
|
0.010
|
0.081
|
Gulf Power Co
|
|
0.310
|
|
Nevada Power Co
|
0.595
|
0.410
|
|
Southwestern Public Service Co
|
|
0.018
|
0.612
|
Arkansas Power & Light Co; aka Entergy Arkansas LLC
|
0.330
|
|
|
Central Louisiana Elec Co Inc; aka Cleco Power LLC
|
|
|
0.004
|
Public Service Co of Oklahoma
|
|
|
0.018
|
Panel B: Houston
Candidate utility
|
Case 1: No covariates and multiple years of pre-restructuring price data
|
Case 2: Covariates
|
A: Multiple years of pre-restructuring price data
|
B: Single year of pre-restructuring price data
|
Central Louisiana Elec Co Inc; aka Cleco Power LLC
|
|
0.091
|
|
El Paso Electric Co
|
0.042
|
0.228
|
0.215
|
Mississippi Power & Light Co; aka Entergy Mississippi LLC
|
0.255
|
0.120
|
|
Northern Indiana Pub Service Co
|
0.104
|
0.084
|
0.130
|
Sierra Pacific Power Co
|
0.210
|
0.122
|
|
Southwestern Electric Power Co
|
|
0.322
|
0.289
|
Southwestern Public Service Co
|
|
0.002
|
0.040
|
Tucson Electric Power Co
|
|
0.032
|
|
Gainesville Regional Utilities
|
0.389
|
|
|
Florida Power & Light Co
|
|
|
0.311
|
Northern States Power Co; aka Northern States Power Co - Minnesota
|
|
|
0.014
|
Note: The covariates are (a) state-level data for per capita income, per capita employment, cooling degree days, heating degree days, and shares of coal-fired, natural-gas-fired, hydro, solar, wind generation; (b) utility-level data for MWh sales and shares of MWh sales by customer class; (c) whether the utility is an investor-owned utility (IOU); and (d) whether the utility belongs to a regional transmission organization (RTO).
The placebo test results presented in Appendix 2 further support the contention that restructuring had a discernible effect on prices in Dallas and Houston.
6.2 Residential price comparison
Corresponding to our methodology’s second step, Figure 1 based on Case 1 shows that regulated prices in Dallas and Houston closely match the associated regulated rates of the SCs in the pre-retail-competition period of 1990-2000. As expected, electricity prices in Dallas and Houston jumped in 2001, reflecting the PUCT’s order that allowed the investor-owned utilities affected by Senate Bill 7 to recover the previously uncollected fuel costs prior to the start of full-scale customer choice on 01/01/2002. Moreover, actual retail prices exceed SC rates in 2001-2020, thus indicating retail competition’s price-increasing effect. Figures 2 and 3 based on Cases 2A and 2B affirm the key message conveyed by Figure 1: retail competition has generally raised retail prices in Dallas and Houston. Finally, Figures 1 to 3 seem to suggest that the price increases in Dallas are below those in Houston. However, our regression results for Model 2 in Section 6.3 indicate that the negative difference between the Dallas’ and Houston’s price increases is highly insignificant (p-value > 0.5).
We end this section by identifying the main cause of retail competition’s price-increasing effect portrayed in Figures 1 to 3. As suggested in Figure 4, the gaps between actual prices in Dallas and Houston and counterfactual rates increase with wholesale natural gas prices. This positive correlation is expected, as ERCOT’s wholesale electricity prices increase with wholesale natural gas prices (Zarnikau et al., 2019) and are passed through to residential pricing plans (Brown et al., 2020a). In contrast, the weighted average of regulated rates of the SC’s integrated utilities reflects the average fuel costs of electricity generation, which are below ERCOT’s marginal energy costs when natural gas prices are high. In summary, relatively high wholesale natural gas prices are a main contributing factor to the discernible gap between actual prices and counterfactual rates in Houston and Dallas, particularly around the 2008 spike in the US wholesale natural gas prices. When wholesale natural gas prices were low in 2016, retail electricity prices in Dallas and Houston were equal to or lower than the counterfactual.
6.3 Regression results
Corresponding to our third step, we use a panel data analysis to estimate the impact of retail competition on prices for two reasons. First, the price comparisons portrayed in Figures 1 to 3 are sensitive to how SC is constructed. However, we cannot a priori ascertain which synthetic control is more empirically reasonable for creating the counterfactual rates for Dallas and Houston, as all three SC are constructed to match the two cities in the pre-retail-competition period. Second, the panel data analysis estimates the average price impact from retail competition for the unfettered competition period that is useful for computing retail competition’s aggregate bill impact. A good case in point is the comparison of the WSJ’s reported bill impact of ~$1.75 billion per year and our calculated bill impact of ~1.09 billion per year.
Our panel data analysis has two models. Model 1 assumes constant price impacts and Model 2 assumes city-dependent price impacts. Importantly, the regression results from each model presented in Table 5 are insensitive to the assumption of fixed vs. random effects of city and SC construction.
Thanks to our use of SC, Model 1’s intercept estimates in Table 5 are highly insignificant (p-value > 0.9) and virtually equal to zero. The highly significant (p-value < 0.01) coefficient estimate for the binary indicator for the transition period is $0.0112/kWh ($11.2/MWh), which is smaller than the coefficient estimates of $0.0134/kWh ($13.4/MWh) for the binary indicator for the period of the unfettered competition period.
Table 5. Panel data analysis of per kWh charge for residential electricity consumption; sample period = 1990-2020; sample size = 31 years × 2 cities × 3 SC cases = 186 observations; statistically significant (p-value ≤ 0.05) estimates in bold based on robust errors clustered by city and SC case
Variable
|
Model 1: Constant price impacts
|
Model 2: City-dependent price impacts
|
Fixed effects
|
Random effects
|
Fixed effects
|
Random effects
|
Estimate
|
Standard error
|
p-value
|
Estimate
|
Standard error
|
p-value
|
Estimate
|
Standard error
|
p-value
|
Estimate
|
Standard error
|
p-value
|
R2: within
|
0.2752
|
|
|
0.0000
|
|
|
0.2765
|
|
|
0.2765
|
|
|
R2: between
|
0.0000
|
|
|
0.0000
|
|
|
0.0147
|
|
|
0.0147
|
|
|
R2: overall
|
0.2462
|
|
|
0.2462
|
|
|
0.2489
|
|
|
0.2489
|
|
|
Intercept
|
-0.0000
|
0.0020
|
0.982
|
-0.0000
|
0.0002
|
0.797
|
-0.0000
|
0.0020
|
0.982
|
-0.0000
|
0.0002
|
0.798
|
Binary indicator for the transition period = 1 if 2001-2006, 0 otherwise
|
0.0112
|
0.0021
|
0.003
|
0.0112
|
0.0021
|
0.000
|
0.0124
|
0.0030
|
0.009
|
0.0124
|
0.0030
|
0.000
|
Binary indicator for the period of unfettered competition = 1 if 2007-2020, 0 otherwise
|
0.0134
|
0.0035
|
0.013
|
0.0134
|
0.0035
|
0.000
|
0.0139
|
0.0050
|
0.039
|
0.0139
|
0.0050
|
0.005
|
Binary indicator for the transitional period × Binary indicator for Dallas
|
|
|
|
|
|
|
-0.0024
|
0.0040
|
0.575
|
-0.0024
|
0.0039
|
0.537
|
Binary indicator for the period of unfettered competition × Binary indicator for Dallas
|
|
|
|
|
|
|
-0.0011
|
0.0071
|
0.887
|
-0.0011
|
0.0070
|
0.878
|
Table 6. Panel data analysis of electricity price gap ($/kWh) vs. Henry Hub’s wholesale natural gas price ($/MMBtu); sample period = 2001-2020; sample size = 20 years × 2 cities × 3 SC cases = 120 observations; statistically significant (p-value ≤ 0.05) estimates in bold based robust errors clustered by city and SC case
Variable
|
Fixed effects
|
Random effects
|
Estimate
|
Standard error
|
p-value
|
Estimate
|
Standard error
|
p-value
|
R2: within
|
0.2998
|
|
|
0.0000
|
|
|
R2: between
|
0.0000
|
|
|
0.0000
|
|
|
R2: overall
|
0.2295
|
|
|
0.2295
|
|
|
Intercept
|
-0.0004
|
0.0021
|
0.857
|
-0.0004
|
0.0040
|
0.919
|
Binary indicator for the transition period = 1 if 2001-2006, 0 otherwise
|
-0.0083
|
0.0015
|
0.003
|
-0.0083
|
00015
|
0.000
|
Henry Hub’s wholesale natural gas price
|
0.0035
|
0.0005
|
0.001
|
0.0035
|
0.0005
|
0.000
|
Note: The coefficient estimates in the last row measure the estimated effects of a $1/MMBtu increase in wholesale natural gas price on the electricity price gap in 2001-2020.
Intercept estimates for Model 2 are highly insignificant (p-value ≥ 0.8) and virtually equal to zero. The highly significant (p-value < 0.01) coefficient estimate for the binary indicator for the transition period is $0.0124/kWh ($12.4/MWh), which is smaller than the coefficient estimate of $0.0139/kWh ($13.9/MWh) for the binary indicator for the period of unfettered competition. Finally, the interaction terms in the last two rows have highly insignificant (p-value > 0.5) coefficient estimates, indicating that the estimated impacts of retail competition upon prices are not city-dependent.
We end this section by performing a panel data analysis of the relationship between the electricity price gap and the wholesale natural gas price set at Henry Hub, a major trading hub for natural gas in the neighboring state of Louisiana. The coefficient estimates in the last row of Table 6 are 0.0035 (p-value < 0.01), thus reinforcing the key takeaway from Figure 4: the gaps between actual prices in Houston or Dallas and counterfactual rates increase with wholesale natural gas prices.
[6] We note one limitation of this approach. Hill (2023) reports difficulty in using this method to assess market reforms in states with high electricity prices (e.g., the Northeast US). We have had similar difficulty in our attempts to examine the impacts of retail competition on prices in Boston, New York, and other cities in that region. The problem is finding control group candidates with high prices that did not undergo retail market restructuring. There may be too few candidates to make this approach work.