Awesome
PSSE RAW
This packages parses PSSE RAW files in pandas dataframes.
Alternative Packages
Overview
The program is composed of
psse.py- Reads through the file and changes it's mode based on signals received.
- Stores the data based on the current mode
psse-modes.yaml- Describes the structure of the RAW format.
- Can create different mode files to describe different RAW versions (not currently implemented)
format_components.py- An opinonated way to format the RAW data, based on pypsa
The current psse-modes file is for a specific RAW format. There are no gaurentees that it parses the given format or any format correctly.
If you are planning on using, validate the output.
Errors/Updates/Corrections
Submit any corrections or new modes and pull requests.
Sample scripts
The following are examples of ways to use the module
parse.pyparses and prints datanetwork.pyperforms simple network analysisscripts/process.shprocesses folder of raw files
Example Usage
python3 parse.py --input data/ERCOT_SS-18SSWG_2021_SUM1_Final_06252018.RAW --debug
### Output
...
...
...
DEBUG:em.parse_raw:switchedshunt
DEBUG:em.parse_raw:
I MODSW UK1 UK2 VSWHI VSWLO SWREM ... B5 N6 B6 N7 B7 N8 B8
0 1 1 0 1 1.03 0.95 0 ... NaN NaN NaN NaN NaN NaN NaN
1 99 1 0 1 1.03 0.95 0 ... NaN NaN NaN NaN NaN NaN NaN
2 107 1 0 1 1.03 0.95 0 ... NaN NaN NaN NaN NaN NaN NaN
3 126 1 0 1 1.03 0.95 0 ... NaN NaN NaN NaN NaN NaN NaN
4 149 1 0 1 1.03 0.95 0 ... NaN NaN NaN NaN NaN NaN NaN
[5 rows x 26 columns]
DEBUG:em.parse_raw:zone
DEBUG:em.parse_raw:
I ZONAME
0 1 'TEMPORAR'
1 2 'BRYAN '
2 3 'DENTON '
3 4 'GARLAND '
4 5 'KOPPERL '
DEBUG:em.parse_raw:gen
DEBUG:em.parse_raw:
I ID PG QG QT QB ... O3 F3 O4 F4 O5 F5
0 967 'V1' 0.0 0.0 1.0 -100.0 ... 0 1.0 0 1.0 0 1.0
1 967 'V2' 0.0 0.0 1.0 -100.0 ... 0 1.0 0 1.0 0 1.0
2 5920 'EQ' 599.4 0.0 360.0 -360.0 ... 0 1.0 0 1.0 0 1.0
3 6103 'EQ' 219.0 0.0 132.0 -132.0 ... 0 1.0 0 1.0 0 1.0
4 40426 'B1' 0.0 0.0 20.0 -20.0 ... 0 1.0 0 1.0 0 1.0
[5 rows x 28 columns]
DEBUG:em.parse_raw:multiline
DEBUG:em.parse_raw:
I J ID DUM1 DUM2 ... DUM5 DUM6 DUM7 DUM8 DUM9
0 5568 42540 '&1' 1 43221 ... NaN NaN NaN NaN NaN
1 5915 42530 '&1' 2 47531 ... NaN NaN NaN NaN NaN
2 40010 40430 '&1' 1 40439 ... NaN NaN NaN NaN NaN
3 40010 41330 '&1' 1 41440 ... NaN NaN NaN NaN NaN
4 40015 40170 '&1' 1 40171 ... NaN NaN NaN NaN NaN
[5 rows x 12 columns]
DEBUG:em.parse_raw:owner
DEBUG:em.parse_raw:
I OWNAME
0 1 '1'
1 9 'TAEPTC '
2 11 '11'
3 12 'TAEPTN '
4 18 'RAIRLG '
DEBUG:em.parse_raw:facts
DEBUG:em.parse_raw:
N I J MODE PDES QDES ... LINX RMPCT OWNER SET1 SET2 VSREF
0 1 9025 0 0 0.0 0.0 ... 0.05 100.0 190 0.0 0.0 0
1 2 11172 0 1 0.0 0.0 ... 0.05 100.0 794 0.0 0.0 0
2 3 11173 0 1 0.0 0.0 ... 0.05 100.0 794 0.0 0.0 0
3 4 80319 0 1 0.0 0.0 ... 0.05 100.0 9 0.0 0.0 0
4 5 80320 0 1 0.0 0.0 ... 0.05 100.0 9 0.0 0.0 0
[5 rows x 19 columns]
DEBUG:em.parse_raw:fixedshunt
DEBUG:em.parse_raw:
I ID STATUS UK1 B
0 5915 'R1' 0 0.0 -150.0
1 5915 'R2' 0 0.0 -150.0
2 38046 'C1' 1 0.0 20.0
3 38046 'C2' 1 0.0 20.0
4 38046 'C3' 1 0.0 20.0
DEBUG:em.parse_raw:twodc
DEBUG:em.parse_raw:
I MDC RDC SETVL VSCHD ... ICI IFI ITI IDI UK3-A
0 '1 ' 1 0.000 -219.0 82.0 ... 0 0 0 1 0.0
1 '2 ' 1 0.050 599.4 164.0 ... 0 0 0 1 0.0
2 '3 ' 1 0.036 -149.0 42.2 ... 0 0 0 1 0.0
3 '4 ' 1 0.036 -149.0 42.2 ... 0 0 0 1 0.0
[4 rows x 46 columns]
DEBUG:em.parse_raw:transformer
DEBUG:em.parse_raw:
I J K CKT CW CZ ... VMI3 NTP3 TAB3 CR3 CX3 UK5-A
0 240 241 36996 '2 ' 1 1 ... 0.9 33.0 0.0 0.0 0.0 0.0
1 240 241 36997 '1 ' 1 1 ... 0.9 33.0 0.0 0.0 0.0 0.0
2 973 834 974 '1 ' 1 1 ... 0.9 33.0 0.0 0.0 0.0 0.0
3 977 979 957 '2 ' 1 1 ... 0.9 33.0 0.0 0.0 0.0 0.0
4 977 976 958 '1 ' 1 1 ... 0.9 33.0 0.0 0.0 0.0 0.0
[5 rows x 83 columns]
DEBUG:em.parse_raw:area
DEBUG:em.parse_raw:
I ISW PDES PTOL ARNAME
0 1 0 0.0 10.0 'ONCOR_ED '
1 2 0 0.0 10.0 'RYBRNTSP '
2 3 0 0.0 10.0 'TEXLATSP '
3 4 0 0.0 10.0 'CNP_TSP '
4 5 0 0.0 10.0 'CPS_TSP '
DEBUG:em.parse_raw:branch
DEBUG:em.parse_raw:
I J CKT R X B ... O2 F2 O3 F3 O4 F4
0 1 5 '1 ' 0.002788 0.014900 0.00415 ... 0 1.0 0 1.0 0 1.0
1 1 11 '1 ' 0.005850 0.030030 0.00832 ... 0 1.0 0 1.0 0 1.0
2 2 4 '1 ' 0.004453 0.023790 0.00665 ... 0 1.0 0 1.0 0 1.0
3 2 13 '1 ' 0.000332 0.003062 0.00091 ... 0 1.0 0 1.0 0 1.0
4 2 964 '1 ' 0.000660 0.005760 0.00536 ... 0 1.0 0 1.0 0 1.0
[5 rows x 24 columns]
DEBUG:em.parse_raw:bus
DEBUG:em.parse_raw:
I NAME BASKV IDE AREA ... VA AMAX AMIN BMAX BMIN
0 1 'ROANSPRARE ' 138.0 1 11 ... 69.709279 1.05 0.95 1.05 0.95
1 2 'KEITHSW ' 138.0 1 11 ... 69.756469 1.05 0.95 1.05 0.95
2 4 'IOLA ' 138.0 1 11 ... 69.975923 1.05 0.95 1.05 0.95
3 5 'SANDYSW ' 138.0 1 11 ... 69.697614 1.05 0.95 1.05 0.95
4 6 'HWY6 ' 138.0 1 11 ... 67.540633 1.05 0.95 1.05 0.95
[5 rows x 13 columns]
DEBUG:em.parse_raw:load
DEBUG:em.parse_raw:
I ID STATUS AREA ZONE PL QL IP IQ YP YQ OWNER A B
0 1 '1 ' 1 11 11 7.626 2.961 0.0 0.0 0.0 0.0 115 1 0
1 4 '1 ' 1 11 11 7.807 0.835 0.0 0.0 0.0 0.0 115 1 0
2 6 '1 ' 1 11 11 5.095 1.523 0.0 0.0 0.0 0.0 115 1 0
3 7 '1 ' 1 11 11 8.897 1.020 0.0 0.0 0.0 0.0 115 1 0
4 8 '1 ' 1 11 11 3.709 0.831 0.0 0.0 0.0 0.0 115 1 0
Example jq join
jq -s '.[0] * .[1]' bus-ercot_ss-18sswg_2021_sum1.json line-ercot_ss-18sswg_2021_sum1.json > ercot_ss-18sswg_2021_sum1.json